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Introduction 


The idea to design experiments systematically and with a 
view to their statistical analysis was first promoted by R. A. 
Fisher in his well known book “The Design of Experiments”. 
Fisher also proposed the majority of the designs discussed in 
the present volume. Several designs of great importance, notably 
the quasifactorial designs and the incomplete balanced block 
designs, were discovered by F. Yates. R. A. Fisher’s book, 
however, as well as other publications by R. A. Fisher and 
F. Yates and their school are not written for mathematicians. 
Thus the main emphasis is placed on the explanation of the 
procedure with little or no attention being paid to a mathe- 
matical formulation of the assumptions and to the principles of 
statistical inference which lead from the assumption to the 
statistical method. Moreover, also in many other important 
papers on analysis of variance and design of experiments proofs 
and derivations of formulae are barely sketched if not totally 
omitted. The present book tries to fill this gap and the main 
emphasis is therefore given to a rigorous mathematical treat- 
ment of the subject. 

In writing this volume the author had in mind a reader with 
a mathematical background of a student, who majors in mathe- 
matics and is in his senior year. References are given whenever 
the text exceeds this background. 

The book is designed to serve three different purposes. First, 
it was intended to enable a mature mathematician with no 
background in statistics to study the analysis of variance and 
analysis of variance designs within a reasonably short time. 
Secondly, it is intended to serve as a text book for a graduate 
or advanced undergraduate course in the subject. Finally, it is 
hoped that this book will be studied by practical experimenters 
and statisticians who wish to study the mathematical methods 
used in the analysis of variance and in the construction of 


ix 


* 


analysis of variance designs and are willing and able to expend 
the time and effort necessary for this purpose. 

My thanks are due to the Iowa State College Press for their 
kin d permission to include in this book the tables of the F-dis- 
tribution of G. W. Snedecor’s “Statistical Methods” and to the 
Department of Statistics, University of London, University 
College for their kind permission to republish P. C. Tang’s 
tables of the power function of the analysis of variance test from 
the second volume of the “Statistical Research Memoirs”. 

I am indebted to Mr. Ransom Whitney who has assisted me 
in reading the manuscript and the proofs. I also wish to ac- 
knowledge my indebtedness to Professor W. G. Cochran for 
a very helpful letter. 


CHAPTER I 


Chi-square Distribution and Analysis of 
Variance Distribution 

In this chapter certain fundamental concepts of the prob- 
ability calculus are used. The reader who is not acquainted with 
these concepts should first acquire the necessary background 
by reading, for instance, Uspensky's, “Introduction to Mathe- 
matical Probability,” Chapter XII. Sec. 8, example 3, Chapter 
XIII. Secs. 1-4 and 6, Chapter XV, Secs. 1-6. 

Let ai! , • • • , x N be normally and independently distributed 
variables with variances 1 and means 0. We wish to calculate 
the distribution of the expression 

X 2 = x\ + xl + ••• + xl . 

The joint distribution of x, , • • • , x N is given by the prob- 
ability density function, 

P(x, , • • • , x N ) = exp [-(x? + • • • + x 2 n )/2\. 

Hence the probability that 

X 2 = x\ + • • • + xl < R 2 

is given by 

L (2tt)" /2 6 * ^ dXl ‘ ' ‘ dxN 

where is the sphere with radius R and center 0. The prob- 
ability that 

R 2 < X 2 < (R -f A R) a 
is, therefore, given by 

C J e x /2 dxi ■ • ■ dx N 

R 2 <X <{R + A Rj* 

1 


2 


where C is a certain constant independent of R. If we denote 
the probability that x 2 5= R 2 by P{x < R 2 ) we, therefore, 
have 

A[P(x 2 < R 2 )] = C e~ x “' 2 to 

where R 2 < x* 2 < (R + A R) 2 and to is the volume of the 
spherical shell R 2 < x < (R + Aft) 2 . This volume is given 
by to = C , R n ~ 1 AR. If now A R approaches 0, we obtain 


dP (x 2 < R 2 ) 

dR 


C"e-*' /2 R N -\ 


Hence since x 2 > 0 

P(X 2 <R 2 )= [* C" e -*’ /2 x "- 1 d X 

Jo 

= r C{ x y N - 2)/2 e - % ' /2 dx 2 . 

Jo 

The probability density of x 2 is therefore, 

P(x) = C(x 2 Y N ~ 2)/2 e~ x ’ /2 for x 2 > 0 
= 0 for x 2 < 0. 

The constant C still remains to be determined. We must have 


C f (x 2 )'"~ 2>/2 e~ xV2 d x 2 = 1. 

Jo 

Hence 


<tf-2)/2 g-xV2 

= 2 n/2 f x (N ~ 2)/2 e~ x 
Jo 



* - 2"r(f), 


( N - 2)/2 


_-X 9 /2 



where 

r(z) = [ x 9 ~ l e~ x dx 
Jo 


is the well known r function. 


Hence we finally have 
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2\<J\T- 2)/2 g-»X’/2 


The number N in this distribution is called the number of 
degrees of freedom. 

This distribution is tabulated in almost every modern book 
on statistics for all degrees of freedom under 31. For larger 
values of N the quantity (2x 2 )* — (2 N — 1)* is approximately 
normally distributed with mean 0 and variance 1. For large 
values of N also (x 2 ~ N)/ (2A 7 )* is approximately so distributed. 

If xi has n x degrees of freedom and x* has n 2 degrees of 
freedom, then xi , (xl) is distributed as is the sum of n, , (n a ) 
independently and normally distributed variates. Hence we 
have 

Theorem 1.1: Let x? , X 2 , • • • , x» be independently distributed 
variables such that x< has the x 2 distribution vrith n< degrees of 
freedom then 


2 2 1 2 1 | 2 

X = Xi + X2 + • • • + X. 


has the x distribution with rti + n 2 + • • • + n, = n degrees 
of freedom. 

All of the theory of analysis and design of experiments which 
is presented in this book is based on the distribution of the 
ratio of two independent chi-square expressions. We therefore, 
proceed to derive this distribution. 

Suppose that x? is distributed according to 1.2 with n, de- 
grees of freedom, and X 2 with n 2 degrees of freedom and suppose 
that x> and x! are independently distributed. The joint distri- 
bution of xi and x 2 is then given by its density function 



1 


T(n 1 /2)r(n a /2) 


•(xx) <ni - 2,/2 (x 2 2 ) 


,2\ («i — 2)/2 / 2\ (na — 2) / 2 


exp [-(x 2 + X 2 )/ 2 ]. 
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We put 


2 i 2 

Xi + X2 = 2:. 


(1.3) 



To every pair of values y > 0, z > 0, there exists one and only 
one pair of values xi > 0, xl > 0. We, therefore, obtain the 
probability density of y and z by transforming P(xi , x*) by 
means of 1.3. From 1.3 we have 


dx? 

dxi 


z 

y 

dy 

dz 


(1 + y ) 2 

1 + y 

dxl 

3X2 


—z 

1 

dy 

dz 


(1 + y ) 2 

l + y 


(i + y ) 2 • 


Hence the probability density of y and z is given by 

1 y < n >- 2),2 / W B , + «,- 2>/2 

2r(n 1 /2)r(n 2 /2) (1 + \ 2 ) 


for z > 0, y > 0, 

and is 0 for either z < 0 or y < 0. 

Integrating out with respect to z from 0 to 00 , we obtain the 
density function of y 


(1.4) 


H(y) = 



Hence the probability that y > y > 0 is given by 


(1.5) 


f H(y) dy. 


The variable y was defined as the quotient of two independent 
chi-square expressions xi and X2 with rq and n 2 degrees of 
freedom respectively. We shall consider the variable F given by 


F = 


rh Xi 
Wi X 2 


rq 

n 2 


F = y. 


The probability of obtaining an F larger or equal to F is ac- 
cording to 1.5 and 1.4 given by 



(1.6) = f r([n, + n,l/2) (n,/n,^ / »F < -- ,,/ ^ 

h r(n,/2)r(n,/2) (i + n 1 F/n 2 ) < "‘ +n * ,/2 

= 0(F). 

The values F and F for which 

G(F) = .05, G(F) = .01. 

have been tabulated by G. W. Snedecor in his books “Statistical 
Methods” and “Analysis of Variance and Covariance,” which 
also contain a large collection of interesting applications of the 
X s and F statistic. 


CHAPTER II 


Matrices, Quadratic Forms, and the 
Multivariate Normal Distribution 

A matrix is a rectangular array of coefficients 

' 

^ll , * * * , n 

^wl j * * * ) & mn> 

We shall denote such a matrix by (an) whenever the meaning 
of the numbers m and n will be clear from the context. 
Consider a system of linear forms 

(2.1) Li = anXi + • • • + ciinXn , i = 1, • • • , m. 

The matrix (a it ) is called the matrix of the linear forms L { in 
Xi , • • • , x n . Suppose now that the x { are themselves linear 
forms in the variables y x , • • • , y, 

(2.2) Xi = b n yi + • • • + bj.y. . 

Then 

n ns s n 

L{ = ) , aijXi = ~ ) 1 ) 1 a>nbi k y k ) 1 y k ) 1 (tubnc j 

1-1 1- 1 Jj -1 k - 1 1—1 


i = 1, •••, m. 

The Li are therefore linear forms in the variables y, , ■ • • , y, 
with the matrix ( c ik ) where 

Cue = S anbik , i = 1, • • • , m, k = 1, • • • , s. 

i-i 

It is therefore natural to define the product of two matrices 

by 

(2.3) (flu)(bik) = ( Xj a a &.*)• 
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Note that the product is only defined if (a,-,) has as many 
columns as (b, t ) has rows. 

If we put 



/ 

u 


/■ 

Xi 

(L) = 


(x) = 

• 


,L m . 


X mi 


we may rewrite (2.1) in matrix form as 
(2-4) (L) = (a if )(x). 

To a limited extent matrix notation and some of the most 
elementary theorems on matrices will be used in this book. 
If the reader is not familiar with the most elementary aspects 
of the theory of matrices, he should acquire the necessary 
background by reading, for instance, in A. A. Albert’s book 
“Introduction to Algebraic Theories” Chapter 2 and 
Chapter 3, Section 1 to 11. Albert’s book will be referred to 
as (AAA). We shall review here some elementary theorems 
which will be used in this chapter. 

The multiplication of matrices is associative (AAA III. 2.) 
That is to say, if A, B, C are matrices such that ( AB ) and 
( BC) are defined then 

(2.5) (AB)C = A(BC). 

The multiplication of matrices is not commutative. That 
means that AB is not always the same as BA. In fact AB may be 
defined whilst BA is not. 

The determinant of a square matrix (a,-,) = A will be denoted 
by | a,-, | or | A |. The equation 


( 2 . 6 ) 

holds (AAA, III, 5). 


AB\=\A\\B\ 
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The matrix 


(2.7) 


10 

01 


0 

0 


= I 


0 •• 


lj 


is called the unit matrix and it is easy to verify that A I = 
I A = A for every A for which I A and AI are defined. 

If and only if | A | ^ 0 then A is called non singular and 
possesses an inverse A' 1 for which (AAA, III, 6). 

(2.8) AA' 1 = A-'A = 7. 


We shall always use the notation (<r iy ) -1 = (a'’). 

To every matrix (a,-,-) = A we can construct the transposed 
matrix A' by interchanging rows and columns. One easily 
verifies the laws 

(2.9) ( AB)' = B'A', (. AB)- 1 = (A -1 )' = A'~\ 

The symbol A' will be reserved in this book for the trans- 
posed of A. 

We consider quadratic forms 

(2.10) <3 = E E anXfXj , an = o 1( . 

*-l 1-1 


We may write Q in matrix form 
(2.11) Q = x' Ax, 


where 


A = (an), 



x 


nJ 


A is called the matrix of Q in the variables x, 


Suppose that 
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* = Py, 


P = 


Pn ••• Plm 
.Pnl * Pnm / 


Then 


Vi 


(2.12) Q = x'Ax = y'P'APy. 

Hence the matrix of Q in terms of the variables y x , • • • , 
y m is given by P'AP. 

A quadratic form in x 2 , • • • , x n is called positive definite if 
it takes only positive values when the variables Xi , ■ ■ • , x n , 
take real values not all equal to 0. It is called semi-definite 
when it takes only non negative values (positive and 0) for 
real x x , • • • , x n . Any quadratic form may, by a non singular 
transformation (AAA, III, 11.) 

w 

Li CijXj , l 1, * * • , 7hy 

1-1 

be transformed into 

r 

Q = £ CiL] , r < n, c { 0. 

* — i 

The number r is called the rank of Q and is independent of the 
transformation provided it is non singular. The c, must all be 
positive, if_Q is positive semidefinite and the transformation 
Li = (c.O^L, leads to 

Q = El!. 

If Qi has the rank n, and Q 2 the rank n 2 then Q, + Q 2 has 
at most the rank n, + n 2 for 

Qi + = e l \ + i: m ) . 
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Some of the L, or M ,• may be represented in terms of the others. 
Eliminating as many of them as possible we obtain 

Qi + Qi = E E UiNtN, n' < n x + n 2 , 

i - 1 J - 1 

where the Ni are independent linear forms in the x’s. Hence 
Qt + Q 2 has at most the rank n x + n 2 . Hence we have 

Lemma 2.1: The sum, of the ranks of s quadratic forms is not 
smaller than the rank of their sum. 

If x x , x 2 are two random variables with the means ui and 
m 2 then 

E(x i Mi) (3-2 M 2 ) = <r a 1 


where E denotes the mathematical expectation, is called the 
covariance of x x and x 2 . 

Let Xi , • • • , x r be r jointly normally distributed variables 
with means 0 and covariance matrix (<r,-,). Their density 
function is given by 


(2.13) P(x, 


Xr) = 




( 2 *) 


r/2 


E E 


x,x,- 


Vi, 


where the quadratic form in the exponent is positive definite. 

The probability P[(x, , • • • , x r C T] that the point 
(x x , • • • , x r ) is in a subspace T of the r dimensional space is 
given by 


P[(X, , • • • , Xr) C T\ 


(2.14) 



Xr) dx 1 dx 2 • • ■ dx r . 


If E{xi) = Mi ^ 0 then we make the transformation x' = 
Xi — Hi ■ We shall formulate the results of this chapter for 
the case that E(x ( ) = 0. It will be easy to find the proper 
formulation for the case P(x.) = m; • 
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We apply a non singular linear transformation (AAA, III, 6). 

r 

(2.15) Xi = Z VaVi , i - 1 , • ’ * , r. 

»- 1 


The Jacobian determinant of this transformation is | Pa 
and the new density function of the y’s is therefore given by 


(2.16) Q( Vl , • • • , y r ) = 


(2x)' /2 | (7ij \' n 


r 1/2 Z W , 


where (P) = (p if ), (<r*”) = P'(a")P, and || P || denotes the ab- 
solute value of | P |. We may then write the constant term in 

(2.16) as 

wn\ = I = i 

(2x) r/2 | | 1/2 (2x) r/2 | P-'iaJP'-' | 1/2 (2x) r/2 | <r*j \ ' 

We see therefore that the y’s are also jointly normally dis- 
tributed with means 0 and covariance matrix 


(2.17) (<r*) = P-\a u )P'-\ 


The matrix P is called orthogonal if 

(2.18) P _1 = P' or P'P = PP' = I. 

In terms of the coefficients p ik of P this means 

, fl if i = l 

(2.19) Z ViWn = \ 

k - 1 [0 if l. 

If Xi , • • • , x r are independently distributed with variance 
a 2 then 


( 2 . 20 ) 


fO for i j 

[o- 2 for i = j 
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and it follows from (2.17) that if P is orthogonal 


( 2 . 21 ) 


( 2 
( T 


mv) = p ' 


[0 


0 ' 


p 


2 

a 


= P'P 

f 2 

a • 

■> 

• 0 



f 2 
a • 

• 0 


0 • 

2 

* <r J 


o • 

2 

• (T 


since a scalar matrix (AAA, II, 6, p. 30) commutes with every 
other matrix. Hence we have 


Lemma 2.2: If x x , • • ■ , x r are normally and independently 
distributed with means 0 and common variance a 2 and if 

r 

(2.22) Xi = 22 VuVi i * = 1, 2 • • • , r, 

J-l 

where P = (p,-,) is an orthogonal matrix then the y t are inde- 
pendently and normally distributed all with the same variance a 2 . 

We proceed to prove 

Lemma 2.3: Let 

(2.23) = Qfx) + • • • + Q,(x), 

*« 1 

where Qfx) is a quadratic form in x x , • • • , x r of rank n,- (AAA, 
III, 11). Then there exists an orthogonal transformation 

n 

(2.24) x'i = X V^k , i = 1, ■ • • , n 

k = 1 

such that 

(2.25) Qi = "'lf“ < * = 1, — , * 

fc-»i + • • •+«< — » + l 

if and only if n x + n 2 + • • • + n, = n. 
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In the first place we have by Lemma 2.1 

(2.26) n x + • • • + n, > n 

since the rank of the left side of 2.23 is n. 

Suppose first that there exists an orthogonal transformation 
fulfilling the conditions of Lemma 2.3. Then 2.24 and 2.25 
imply 

(2.27) Mi + • • • + n. = n. 

Now let 5^ n { = n. Since Q< has the rank n, there exist 
transformations 

n 

L, = 51 PikXk 

(2.28) *‘ l 

j — n x + • • ■ + n,_ i + 1, • • • , rii + n 2 + • • • + Wi 
such that 

/ -«!+•• *+n< 

(2.29) Qi = D Lj . 

• • • + «» — i + l 

If the L, were not independent, then the quadratic form 

E 0* = EH 

i-i 

would have a rank smaller than n. But this is impossible on 
account of 2.23. Hence the L i are independent. We may regard 
therefore the transformation (2.28) as one non singular trans- 
formation with j = 1, • • • , n. Putting 



U 


f 

Xi 

L = 

■ 

, x = 



Ln. 


x n . 


we may therefore write L — PX, where P = (p,,) is non 
singular. Since 

q = ±x*= E Q< = EU, 

J- 1 t-1 t-1 
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we have 

X'lX = L'P'- X IP- 1 L. 

But P ,_1 /P _1 i s the matrix of Q as a form in L, , • • • , L„ and 
this matrix is the unit matrix. Hence 

p,-ip-i = j 

P' 1 and therefore also P are thus orthogonal matrices and 
Lemma 2.3 is proved. 

Theorem 2.1: Let x x , • • • , x n be normally and independently 
distributed variables with variance 1. Let 

(2.29) q , + ••• + q . = 

t-1 

where is a quadratic form, of rank n,- . 

The Qi are independently distributed and Q t has the chi square 
distribution with n t degrees of freedom if and only if 

(2.30) ni -)- n 2 -f- ■ • • n, = n. 

Suppose first that the Q, are independently distributed and 
that Qi has the x distribution with n,- degrees of freedom. 
Then by Theorem 1.1 Q, + • • • + Q, has the x 2 distribution 
with n^ + n 2 + • • • + n, degrees of freedom but on account 
of (2.29) it has also the x 2 distribution with n degrees of freedom 
and (2.30) follows. 

On the other hand suppose that n x + • • • + n, = n. Then 
by Lemma 2.3 there exists an orthogonal transformation 

= ^PikX' k 

such that 

ni + « ■ * +n< 

Qi = E x' k \ 

i"*i+ •••+«» — i + l 

But by Lemma 2.2 the quantities x' are normally and inde- 
pendently distributed variables with means 0 and variance 1. 
Hence the Q t are independently distributed and Qi has by our 
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results in chapter 1 the x 2 distribution with n { degrees of 
freedom. This proves Theorem 2.1. 

Corollary to Theorem 2.1: Let x x , • • • , x n be normally and 
independently distributed with means 0 and variance o' and let 
Qi(i = 1, • • • , s) be s quadratic forms in Xi , • • • , x n with ranks 
n x , • ■ ■ , n, and 

Qi + Q2 + • ■ • + Q. = Q = 

t-1 

then nj/n { Qi/Qj has the F distribution with n { and n,- degrees of 
freedom respectively. 

The variables x x /<r, ■ • ■ , xjo are normally distributed with 
variance 1 and means 0. Therefore Q,/v 2 has by Theorem 2.1 
the x 2 distribution with n< degrees of freedom and the corollary 
follows from our results in Chapter 1. 

The corollary to Theorem 2.1 is of importance in the analysis 
of variance. Theorem 2.1 and its corollary were first formulated 
by W. G. Cochran. 


CHAPTER III 


Analysis of V ariance in a 
One Way Classification 


Let X t , • • • , X, be s normally and independently distributed 
variates with common variance a 2 , and let X,- have the mean 
value Hi . For instance, consider s different races of cattle and 
let X, be the birth weight of calves of the *th race. We wish 
to test the hypothesis that Hi — • • • = h. — M- 
Suppose a random sample is taken of n, individuals of X, , 
n 2 of X 2 , • • • , n, of X, . The values obtained are x n , • • • , 
x ltll , from the first variate x 2l , • • • , x 2 „, from the second 
and so forth. Let 


Xn + x i2 + • • • + 

Xi = 

n, 

be the mean of the ith sample and let 

2Ji %ii t I 

x = , n = rii + • • • + n, , 

where denotes summation over all values of i, be the total 
mean. 

We shall first prove the following identity. Let <*i , • • • , 
a, be t numbers, 

ai + • • • + a, 

“ “ t 

their mean then 


(3.1) — 22 («< — “) 2 + k * 2 - 

« t 

Proof: We have 

22 == 22 («< - « + «) 2 

*' i 


= 22 («< ~ «) 2 + 2a 22 (“*' — a) + ta 

t « 
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but 

22 («< ~ a)a = a 22 (a,- — a) = £*( 22 a * ~ 22 “•) = 0 

* » i » 

which proves (3.1). We apply (3.1) to 22. x 2 , and obtain 
(3.2) 22 (xa) 2 = 22 ( x a - a:.) 2 + n { x 2 . 

i i 

Thus 


(3.3) 22 22 a; 2 ,- = 22 2E2 (*<f - Xi ) 2 + 22 n { x 2 . 

» I * j * 

Next we apply (3.1) to 22*' w.x 2 whereby we consider n { x 2 
as the sum of n { quantities. Then x is the mean of all the n 
quantities x, and by (3.1) 

(3-4) 22 n < x *i = 22 »<(*.• — x ) 2 + nx 2 . 


Substituting (3.4) into (3.3) we finally have 

(3.5) 22 E x l = 22 22 ( x u — a:.) 2 + 22 n i( x > — x) 2 + nx 2 . 

* i * i X 


We shall always write E(x) for the mathematical expectation 
of a random variable x. We put 2?(x.) = and l/n 22; njxi = /i 
then (xa — it) = (x,-,- — #t.) — (x< — /i.) and by (3.1) 


22 22 (a;.-,- - x,) 2 

(3.6) 

= 22 22 ( x <i - Mi) 2 - 22 ».-(*< - m <) 2 . 

» » » 


By assumption E(x u — m,) 2 = c 2 independent of i and j. 
Since v 2 ,. = a 2 /n t we obtain from (3.6) 

E[22 22 (x<; — x<) 2 ] = nc 2 — s<r 2 = (n — s)<r 2 . 

» 7 

On the other hand 


22 »<(a:< - x) 2 = 22 n>[(x< - m) - (x - m)] 2 

(3.7) 

= 22 axi(x< - m) 2 - «(x - m ) 2 • 
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But 

(a:,- — m) 2 = (Xi — Mi) 2 + (m< — m) 2 + 2(Xi — M,)(Mi — m). 
Hence 

E(X( — m ) 2 = #(*.- — Mi) 2 + (Mi ~ m ) 2 


(3.8) 


+ 2(m, — M)S(Xi — M.) 



Therefore from (3.7) 


(3.9) 


23[ X) n i( x i — x ) 2 ] = S(7 2 + 53 n *(Mi — m) 2 ~ <r 2 
» *' 

= (s — l)o - 2 + 53 n <(Mi — m) 2 - 


Thus whilst E[53< 53 i (xa- — Xi) 2 ] is an unbiased estimate 
of ( n — s)a 3 regardless of any, hypothesis about the m< we see 
from (3.9) that 53* n <( x < ~ *)* is an unbiased estimate of 
<r 2 only if Mi = M 2 = • • • = M# • Otherwise its expectation is 
larger than <r 2 . That is to say; if the hypothesis Mi = Mj = 
... = ft, = /i is incorrect the ratio 


(3.10) 


n — s 53i ttifo ~ x f 

s-lZ< 13 . ( x ‘i - x ‘f 


will tend to be large. It seems therefore, reasonable to use this 
ratio Fas a statistic for testing the hypothesis Mi = M 2 = 

. . . = ft, = m and to reject this hypothesis on the level of 
significance a if this ratio is larger than could be expected by 
chance with probability a. A theoretical justification for using 
this F ratio will be given in chapters 4 and 6. 

We shall now show that the statistic F defined by (3.10) 
has the F distribution of Chapter 1 with (s — 1) and (n — s) 
degrees of freedom. We first substitute in (3.5) x {i — m for 
Xu . Then 
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E E (*« - m ) 2 = E E (*« - **)• 

* i « i 

(3.11) 

+ E n <( x i — a :) 2 + n(z — /i) J . 


We now put 

E E (*« - x.) a = Q. 

* i 

E w.(x< - X ) 2 = q 2 

* 


of rank m l , 


of rank m 2 , 


n{x — m ) 2 = Q 3 


of rank m 3 . 


Q, is a sum of squares of the linear forms L (i = (a:,-,- — x,). 
Between the L,-,- there exist s obviously independent relations 
E; £./ = 0, i = 1, • • • , s. Since we may put 

r»i-l 

Lim == i ^ = (^-> ••• j s)j 

i-l 

and thus write Qi as a quadratic form in (ra — s) linear forms, 
it follows that Q i has at most the rank n — s. Similarly Q a 
has at most the rank s — 1 and Q 3 has obviously the rank 1. 
But 

(3.13) (n -«) + (•- 1) + 1 - n. 

It follows thus from (3.11) and Lemma 2.1 of Chapter 2 
that m, = n — s, m 2 = s — 1, m 3 = 1. If n l = ai 2 = • • • = n 
then the (x u — n) are by assumption normally and inde- 
pendently distributed with common variance a 2 . By the corol- 
lary to theorem 2.1 


(3.14) 


n — s Qi 

s - 1 Qi 


has the F distribution with n — s and s — 1 degrees of freedom 
respectively. 

If the quantities n t — n are not all equal to 0 then E* 
7ii{Xi — x) 2 /<t 2 does not have the x 2 distribution although 
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E< Ei ( x u ~ Xi) 2 /<r 2 = Qi still has. This may be seen by 
applying (3.1) to obtain 


Qi = E (xu ~ M <) 2 = E (xu — Xi ) 2 + n^Xi — ntf, 


(3.15) 


= Qi + UiiXi — Hi) 2 , 


* = (!,•••,*) 


The rank of Q< is _at most — 1 and it follows from Lemma 1 
in Chapter 2 that Q< has exactly the rank n t — 1. From Theorem 
2.1 and the independence of the Xu it thus follows that 


E E (Xu - X,) 2 /a* 


(3.15) 


has the x 2 distribution with n — s degrees of freedom irre- 
spective of any hypothesis about the Hi • 

In the comparison of classes it is very often desirable to 
test the significance of differences between class means. Suppose 
we wish to test whether there is a difference between the means 
of the ith and the jth class. We put 


riiXi + rijXi 

n< + n,- 





It follows that 

E »*(** - x) 2 = E n i( x i ~ x) 2 + Xi — a:') 2 


k 


lr*i 


(3.17) 


+ nj(Xj — x ')* + (n< + n,)(x' — x) 2 . 


Substituting (3.17) in (3.11) we have, on account of (3.12), 


(3.18) 
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S (*« — m ) 2 = Qi + ]£ n ( a; i — a:) 2 + n,(x,- — a;') 2 

• ’ i*i 

l*i 

+ nfoj — x') 2 + (n, + n,)(x' - x) 2 + n(x - tf. 
The rank of 

2 n ‘(xi ~ a:) 2 + (n,- + n,)(x' — x) 2 


is at most s — 2. The rank of 

n .(x< - a:') 2 + n,(x, - x') 2 = (x. - x,) 2 

W,’ "T" Wy 

is one; hence by the corollary to Theorem 2.1 

(3.19) F = n ~ s n ' n i ( x i ~ a;,) 2 

1 n, ■ + n, Q, 

has the F distribution with 1 and n — s degrees of freedom 
respectively. We have shown before that Q, is not affected if 
Mi Mi but 

E(xi — x,) = #{[(x,- — — ( x ; — Hj) + (ni — /i,)] 2 } 


+ n,- 2 

a 

n i n i 


+ (m.- - M,) 2 - 


Hence (x,- — x,) 2 will tend to be large if Mi differs substantially 
from Mi • It seems, therefore, reasonable to use the F statistic 
in (3.19) to test the hypothesis m. = Mi • 


CHAPTER IV 


Likelihood Ratio T ests and T ests 
of Linear Hypothesis 

Let the variable vector x = (x l , • • • , x n ) have the 
distribution function f(x, 0, , • • • , 0*) depending on k param- 
eters dx , ■ ■ ■ , 0* . We may know that d k , • ■ • , 6 k satisfy certain 
relations. 

?i(0i , • • • , e k ) = 0, . i = 1, • • • , 8, 

(4.1) 

0 < s < k. 

We wish to test the hypothesis that 0, , • • • , d k satisfy certain 
additional relations. 

(4.2) 0, (0! , • • • , 0*) = 0, j = s + 1, • • • , s + r, 0 < r < k — s. 

Let Xi , • • • , x n be an independent sample of nx’s. The dis- 
tribution in the sample space is then given by its probability 
density 

(4.3) p(x i , ■ ■ • , x n ) = n /(Si , 0i , • • • , 0*)- 

i 

For a given sample x k , • • • , x„ the density becomes a func- 
tion p(0 1 , ■ • • , 0*) of 0! , • • • , 0* . Let 0i , • • • 6 k be a set of 
values for which p(0, , • • • , 6 k ) is maximized under the re- 
strictions (4.1). We call 0j , • • • , 0* the maximum likelihood 
estimates of 0i , • • • , 0 k . Maximum likelihood estimates may 
also be obtained under the restrictions (4.1) and (4.2) and 
these estimates will be denoted by 0( , • • • , 0( . Clearly 

(4.4) p(0! , ••• , e k ) > vCe [ , ••• , 0 k ). 

The ratio 

PW , • • • , 00 = x 
v0> i , ■■■ ,e k ) 
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(4.5) 
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is called the likelihood ratio for the hypothesis (4.2). The use 
of X as a statistic to test the hypothesis (4.2) can be justified 
on the basis of certain criteria (see f.i. A. Wald: Tests of 
statistical hypothesis concerning several parameters, when the 
number of observations is large. Trans. Am. Math. Sec. 54; 
pp. 426-482). We shall at this point advance only an intuitive 
argument. Suppose that our hypothesis is false, then X would 
tend to be smaller than if the hypothesis were true. It seems, 
therefore, reasonable to use X as a statistic to test the hypothesis 
(4.2) and to reject it on the level of significance a if X < X 0 
where X 0 is chosen so that P(X < X 0 | 4.2) = a where P(E \ H) 
denotes the probability that the event E will happen computed 
under the hypothesis H. 

All the tests which will be discussed in this book are tests 
of linear hypotheses. We consider a set of N random variables 
2/i > • • • , Vn and put E(y a = p. a ). We shall make the following 
assumptions. 

1) The y a are normally and independently distributed and their 
variances are equal. 

2) The n a are linear functions of p parameters 13! , • • • , (3 P , 
p < N. 

(4.6) /i. = £ , a = 1, ••• , N. 

i 

and the rank (A. A. A. II 7) of the matrix (g ia ) is equal to p. 

Eliminating the /?.- from (4.6) we see that the assumption 2 
is equivalent to assuming that the satisfy N — p linear 
restrictions: 


^ ' hkaUa 0 , k — 1 , * * * , N p , 

(4.60 

rank (X ta ) = N — p. 

The hypothesis we wish to test is that the 0,- satisfy s inde- 
pendent linear restrictions. 


( 4 - 7 ) £ kafii = 0 , 

i 


i = 1> • ’ • , s, 


s < p. 
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The hypothesis can, by eliminating the /3, from (4.6) and (4.7), 
also be written as 


(4.7') 


S p*«M« = 0, k — 1, 
1 

Xu • • • ^ 1 N 


rank 


^■n-v.i • • • Xjv-p.w 
Pn • • ' Pin 


Pai • • • P.w 


= N - p + 


According to assumption 1 the joint density function of 
2/i , ••• , y N is given by 


(4.8) 


1 eXD L ly m . q) . 1 

crW /2 P L 2 « J' 


We now compute the likelihood ratio. The expression (4.8) 
is maximized if we minimize 

(4.9) £ 0/« - Mo) 2 = (l/o - ffxo/3i - • ■ ■ - 0p.fr>) 2 . 

a a 

Let Z>! , • • • , &„ be the maximum likelihood estimates of 
fr , • • • , A, • We put 

(4.10) Q* = X) G/« “ ffiobi - • • • - g V ab P ) 2 . 

a 

Similarly the maximum likelihood estimate of <r is obtained 


as 

(4.11) 


a 2 Qa 


N • 


The maximum hkehhood under the assumptions then be- 
comes 
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<4i2> *--(ssr* r “- 

Let Q r be the minimu m of 

S — Ma) = S (2/0 — <7i a/ 3 , — • • • — g va [ 9 P ) 2 

a 

obtained under the restrictions (4.7) imposed by the hypothesis. 
The maximum likelihood under the restrictions (4.6) and (4.7) 
then becomes 


(4i3 > - - G4P- 

Hence the likelihood ratio is given by 


(4.14) 



In testing a hypothesis we may instead of a given test function 
like X take any monotonic function of it. Hence instead of 
{QJQ r ) N/ * we may take as a test function Q r /Q„ or 


(4.15) 


p = N -PQ r -Q. 

• Q. 


We decided to reject (4.7) if X < X„ whereby X 0 is determined 
so that P(X < X 0 | 4.7) = a. Since F is a monotonically de- 
creasing function of X we obtain a test equivalent to the likeli- 
hood ratio test if we reject (4.7) whenever F > F 0 where 
P(F > F 0 | 4.7) = a. 

We proceed to derive the distribution of the ratio (4.15) 
and we shall show that it has the F distribution of Chapter I 
with s and N — P degrees of freedom respectively. We first 
prove: 


Lemma 4.1: Let 

(4.16) 2 a./M* = 0, t = 1, ,Tc 

be k linearly independent linear restrictions on the values Mi , 
• • • , an . Then there exists a system of restrictions 

(4.16') ^ bap t = 0, * = 1, • • • k 

i 


I 
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such that the restrictions 53; ««;M; = 0, * = 1, • • • 
equivalent to the restrictions 53; &</M/ = 0, t = 1, 


l < k are 
•• ,1 < k 


and such that the rows of the matrix (6 i( ) are orthogonal to each 
other, that is to say such that 


(4.17) 


a-N 


r b ia b ia 


ha 




if i = j 
if i j. 


Proof: We put 


bu 


«i. 

"(5 >w) 1/2 


b?i = cin — hb u where X = 53 buau 

i 

then 

53 &>.&?. = 53 &»<*« - X = 0. 

We then put 

, b*j 

2< "( 53; b* 2 ) V2 

This is possible since 

53 Wf > 0. 

J 

Otherwise the second equation would be a multiple of the first, 
contradicting the assumption of independence of the system 
(4.16). The systems 

53 a<;M; = 0, 53 W; =0, i = 1, 2 

i 

are obviously equivalent. Suppose now that we have succeeded 
in constructing a system 

(4.18) 53 b ia ua = 0, * = 1, ••• , l < k 

a 

fulfilling (4.17), which is equivalent to 

53 <*<«/*« —6, i = 1, • • • , l < K. 


27 


We put 

bl + ia — &1+ ia Ai&j a 

* * * A ibi a , 

where 

A/ = ^ Ql + labja , 
a 

i * * * t 

then 

23 bl + iabja = 23 Ql + labja 

a a 

23 S A { b ia 

a *- 1 


3 = 1, • • • , l. 

Since (4.17) is valid for i, j < 1 we have 

Z &?+lah|a = Z 0|+li>,a — X/ = 0. 

» a 

Now Z« fef + 2 ! > 0 since otherwise the (l + l)st equation 
would be a linear combination of the first l equations, contra- 
dicting the assumption of independence of (4.16). We then 
have only to put 


hl+la — 


W* 1 


(Z« bf +1 ) 


1/2 


to obtain the (l + l)st equation of the system Z<* b ial i a = 0 
fulfilling (4.17) and equivalent to the initial equations of (4.16). 
The process may be continued until all k rows of (4.16') are 
obtained. 

Applying Lemma 4.1 to the restrictions imposed on the n a 
by the hypothesis and the assumptions of the linear hypothesis 
we may assume that the rows of (4.6') and (4.7') are normalized 
and orthogonal, that is to say that 



for t y* j 
for i = j. 
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If p > s we form an additional row t„ , • • • , r ln such that 

12 X,„Ti a = 0, i = lj ‘ • ‘ , P 
* 

T. PiaTla = 0, 


This is possible since N — p s < N equations in N un- 
knowns have a non trivial solution. Thus continuing we finally 
obtain an orthogonal matrix 


• • • ) XlAT 


(4.19) 


Xtf-pi , • • • , X w _„y 

Pn > ■ ' ' » Pin 


P.i > * ’ • > P$N 

Til ) "• l Tiw 


k T p _ 4 1 j l Tv-mN ) • 


We now put 


yt x< 0 j / 0 

a 

(4.20) = 12 P*«2/« 

a 

2/*-p+« + l = 12 TjoJ/a 


for i = 1, • • • , N — p; 
for A; = 1, • • • , s; 


for Z = 1, • • • , p — 8. 
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Let E{y*) = p* . Then 



Ma 53 y 

i 

« = 1, * 

■■ ,N- V ; 

(4.21) M*-p + /3 = 53 Pfiitly y 

i 

0 = 1, • 

, s; 

PN-p + a + y = 53 Tyjflj y 

7=1,- 

,p - s. 


Then since (4.19) is orthogonal 

Z) ( y« ~ /O 2 = Z) (yi - mS 2 - 

a a 

By Lemma 2.2 the (y* — nt) are normally and independently 
distributed with mean 0 and variance a 2 . The assumptions then 
state that p* — 0 for a = 1, • • • , N — p. Hence 

(4-22) Q a = £ yf. 

a — l 

Similarly 

N —p+ a 

Qr = E yf 

a -1 

and 

(4.23) Qr~Q a = yf. 

a- AT— p+1 

Hence under the assumptions Q a is a sum of N — p inde- 
pendent squares and QJo 2 has the x 2 distribution with N — p 
degrees of freedom. Similarly (Q r - Q a )/o 2 has the x* dis- 
tribution with s degrees of freedom and Q r — Q a and Q„ are 
independent of each other. Hence 

(4.24) F = ^ ~ P Qr ~ Qa 

S Qa 

has the F distribution with s and N — p degrees of freedom 
respectively. We, therefore, have 
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Theorem 4.1: Let , y N be normally and independently 

distributed variables with the same variance and means ui > * • • , 
11 ^ respectively. Assume that the y a satisfy the independent rela- 
tions 

(4.25) £ \ ia y a = 0 i = 1, • • • , N - p. 

a 


To test the hypothesis that the y a satisfy relations 
(4.26) X) P<aUa= 0 i = 1, • • • , s s <p. 

a 


independent of the relations (4.25) and of each other, we form the 
ratio 


(4.27) 


F = 


N - P Qr - Qg 

s Q „ ’ 


where Q a is the minimum with respect to y a of (y<* ~ M«) 2 
under the restrictions (4.25) and Q, the minimum of (y a ~ uff 
under the restrictions (4.25) and (4.26). We reject the hypothesis 
(4.26) if F > F 0 where P(F > F 0 \ 4.25 & 4.26) = a and a is 
a fixed constant. Then 


1) The test described is equivalent to the likelihood ratio test 
for the hypothesis (4.26). 

2) The ratio (4.27) has the F distribution with s and N — p 
degrees of freedom respectively. 

We can formulate our assumptions also in the following 
manner. We have 

Va = Ua + «« , 


where the e a are normally and independently distributed 
variables. According to our assumptions (4.6) we have 

(4.28) y a = giaPi + ••• + 0 ,<A + «« , a = 1, -",2V. 

The equation (4.28) is called a linear regression equation of 
y on , • • • , g v . The coefficients 0, , • • • , ft, are termed the 
regression coefficients of y on g x , • • • , g v . We have shown that 
their maximum likelihood estimates bi , — , b v minimize the 
expression 


(4.29) 


^ r (y a filQloc * * * fipQpa) • 
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a 

Hence we must have 


(y a blQlot * ’ * bpQpa") Q i a 0 , 


(4.30) 


i = 1 , • • • > V- 


Multiplying the ith of the equations (4.30) by b t , adding over 
all equations (4.30), and putting 


(4.31) Y a — hiQ'ia + ••• + b v g va 


we obtain 


( 4 . 32 ) 'Ziy* - Y a )Y a = 0. 

a 

The quantity Y a is called the regression value of y a on the 
variables g la , , g pa . 

The minimum Q a under the assumptions is then given by 
E (ya - = Z(Va- Y a )y a - E (Va ~ Y a )Y a 

a a a 

( 4 . 33 ) 

= E yl - E n ■ 

a a 

Let now F* be the regression value of y a on g la , • ■ • , g va under 
the restrictions 4.6 and 4 . 7 . Then similarly 

( 4 . 34 ) Q r = E yl - E Yf. 

"a a 

Hence 

( 4 . 35 ) Qr - Qa = E (Yl - Yf). 

a 

The restrictions ( 4 . 7 ) are equivalent to stating that /3, , • • • , 
may be expressed by p — s parameters y, , • • • , y„_, . 

( 4 . 36 ) / 3 < = Z k >>y i ■ i = 1 , ••• ,P- 

i 

Let Ci , • • • , Cp-, be the maximum likehhood estimates of y, . 
Then 
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(4.37) 


y * = Ec, E »..*.« . 

i t 

Multiplying the fth of the equations (4.30) by k tl c t and 
summing over t and l we obtain 

(4.38) Z (y a - Y a )Y* = 0. 

a 

Since also Z° (2/« — Yt)Yt = 0 we obtain 

E(y« - y*)F* = Z(2/« - y*)y; 

a a 


- Z(y« - yjyj = o. 

a 


Hence 

E ( Y a - Y*) 2 = Z(^ - Y*)Y a 

(4.39) 

= E y« - E Y* 2 . 

a a 

Therefore 


(4.40) 

Qr - Q a = E (Y a - y;) 2 

a 

and 


(4.41) 

F ( N-p ) E- (r. - H) 2 

« Ea ( Va - y.: ) 2 


= at - y Z« r*« 

s Z« y 2 ° 


- Z« y * 2 

- Z* 


Testing a linear hypothesis means essentially testing the sig- 
nificance of the coefficients of a regression equation. 

From (4.33) and (4.39) it follows also that 


(4.42) 


E (Va - Y a ) 2 = E yl - E Yf 

a a a 

- Z(Y a 


Y*) 2 . 


This result can easily be generalized to yield 
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Theorem 4.2: Let H l , • • • , H, be a sequence of hypotheses on 
the means of the variables y a with E(y a ) = y a of the form. 

V 

Hi l Ha — Qiafii y 
*- 1 

H t : Hi & H 2 • • • & H t .i & £ a*,0, = 0, 

i 

k = S(_j 4" 1) ** ■ j j St ^ p 

such that the linear restrictions imposed by H, are independent of 
each other. Let Y 1‘ ’ be the regression value of y a obtained under 
the hypothesis H, then 

£ yi = z (2/„ - nT + £ (n u - n 2> r 

a a a 

(4.43) 

+ ••• + £ ( n - l) - i ".’) 2 + £ ( w . 

a a 

Theorem 4.2 is very useful in reducing the labor involved in 
computing sums of squares of deviations from a regression 
value. 

We now turn our attention to the solution of the equation 
(4.30). We write 

(4.44) £ g ia g ia = a a ■, £ y a g ia = at . 

a a 

Lemma 4.2: Let g — (<7i„), (i = 1, • • • , p, a = 1, • • • , N), 
be any matrix of rank p < N. Pul gg' = (a (1 ). Then the quad- 
ratic form £i £, a^Xi x,- is positive definite. 

Proof: Consider 

£ f 22 — £ ^2 22 

a ' t — 1 • a i i 

= 22 £ o.i x.Xj = Q. 

* i 

clearly Q is either positive definite or positive semi definite. 
If Q = 0 then 
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(4.45) £ g ia Xi = 0, a = 1, • • • , AT. 

« 

Since g has the rank p there are p linearly independent equa- 
tions in (4.45). Therefore, (4.45) has only the solution x,- = 0, 
t = 1, • • • , p. Hence Q is positive definite. 

Corollary to lemma 4.2. The determinant | a u \ is different 
from 0. 

This follows from the fact that all the principal minors of a 
positive definite matrix are positive. 

We may rewrite (4.30) as 

(4.46) X) a./&i = <*<,- t = 1, • • • , p, 

i 


or in matrix form 



/ 

6. 


/ 

a i 

(4.47) (a u m = (a), b = 

• 

II 

• 


K 




Since by the corollary to lemma 4.2 (a u ) is non singular we 
have with (a“) = (a,-,) -1 

(4.48) b = (a 4 ')(a) 

or 

(4.480 &«=£<*"«!, i = 1, • • ■ , p. 

i 

We see that 5, is a linear function with constant coefficients of 
the y a ■ Hence if the y a are jointly normally distributed, then 
the hi are jointly normally distributed and their distribution is 
completely specified if we know their means and their covariance 
matrix. We have putting 

fo for i j 

in = 1 

for i = j, 


1 


(4.49) 
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E(bi) = Z a ” Z 9iaE(y a ) = 23 a” 23 13 0.«0i«ft 

i a i a l 

= 2E a’W, = Z *«.£« = ft • 

i l I 

Thus 6, is an unbiased estimate of ft . Further 

o’tiby = Z Z a' k a' l c ata , = Z Z a'V 1 Z Z 9k«gi»<Tuavt - 


k l 
2 2 


But <r VaV(t = 0 if a 0 and <r Va = & . Hence 

Cittj = cr 2 Z Z a ’* a ' 1 Z QkaQla = ^ Z Z 0**0* ’o*J 

. * 1 a * I 

(4.50) 

2 V' _»* j _M 2 

= o 2-i a = a a - . 

* 

We proceed to prove 

Theorem 4.3: Let Q„ be the minimum of the quadratic form 
Z« (V « — E(y a )) 2 under the assumption 


(4.51) E{y a ) = £ P<g<* + Z 


a = 1, • ■ • , N. 


and Q r its minimum under the restrictions ft = 0, i = 1, • • • , s. 
Let bi , (i = 1, • • • , s), b d (d = s + 1, p) be the least square 
estimates of ft , ft > • • • , ft under the restrictions (4.51) and put 


Then 

(4.52) 


M" - 

Qr ~ Qa = Z Z 


In the following let i, j, k run from 1 to s; d, e, f from s + 1 
to p; a, r from 1 to p. 

Put 


(4.53) 


1 

-1 

ii id 

®i ii a id 


a 

a 



di 

. do 

a d j a it . 


[a a 


(<U"\= (<o. 
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Then by (4.50) 

(4.54) 

We have 


(«T‘ = (co). 



(4.55) 

= Z 2/« - Z Z a.r b,b r = Z 2/a ~ Z • 

a 9 r a „ 

Let bf, d = s + 1, ••• p be the regression values for 
obtained under the hypothesis ft = • • • /3, = 0 Then by 

(4.55) 

Q' ~ Q* ~ Z a i b i + Z a dbd ~ Z a dbd 

i d d 

(4.56) 


= Z a < b i + Z a d(b d — 6*). 


But from (4.46) we have 


Z ade(b e - b?) = - ddibi . 

i - a + 1 


Hence 


(4.57) b. - b* = - Z a"* Z a-, 6, , 


I 


and from (4.46), (4.56) and (4.57) 

Qr ~ Qa = Z MZ a <>&, + Z a idb d ) 


— Z Z a" 1 ' Z a -> b i 


(4.58) 


— Z &<(Z “ok/ + Z ««&.») 


- Z Z Z Z a dk a ,i ‘a. i b j b l 


- Z Z Z Z o,d/a' d ‘a. i b i b / . 
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The coefficient of 5,6, in the expression ’(4.58) is given by 
Q if ^ 1 y ; a d fd Qti ~ & if y i befQ'ei 

d e 0 

(4.59) 

= o>jf dfi = 0 . 

The coefficient of bjb k is given by 

(4.60) a ik - X E a^a’^a. , = e /t . 

d « 

Our theorem is proved if we can prove that c, t = c ik . This is 
proved if we can show that Z» a”c It = S ik . We have 

(4.61) Z 0’%* = 2) a”a, t -ZEE a”o^a' d 'a.,- . 

J j j d e 

Now 

E o”a„- + E ^'a., = = 0. 

i / 

Hence (4.61) becomes 

E + E E E 

I d 0 / 

= E «"<*» + E E a'h !d a dk 

j d f 

= E a"®;* + E “‘V* = • 

I d 

Hence c if = c,, and theorem 4.3 is proved. 

Corollary 1 of theorem 4.3. Let the hypothesis in theorem 4.3 be 


V 


(4.62) 

0? = 

E = 

<-i 

-- 0, t = 1, ••• , 

where the 

rank < 

of (lu) is s. 

1 

Put 


E i* 

t 

t b t = b f 

and ^ — o^ 1- ) 

Then 




(4.63) 


Qr Qa 

= E E eubm . 


» i 
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Proof: Since the rank of (Z,-,) is s we can add p — s rows to 
(ht) to obtain a non singular matrix (l„) with p rows and p 
columns. The j8, are then also linear functions of /3f = 

LtPt , v = 1, • • • , p. Clearly b* = l,,b, must minimize Q a 

and the corollary follows by applying theorem 4.3. 

The most important special case of theorem 4.3 and its 
corollary is the case where s = 1 then 


(4.64) 


1.2 2 

Qr~Q a =H- 


In finding Q a it is sometimes required to minimize Q = 
(Va — X); QaiPi) 2 under some linear restrictions on the 0, 

V 

^ ^ liifij Li Oj i = lj ** * j 8, 

(4.65) 


rank (Z i# ) = s < p. 


Then s of the /3, can be expressed as functions of p — s of them 
and the regression problem may thus be reduced to a regression 
problem in p — s of the /?,• . 

Suppose that all the /?’ s can, by means of (4.65), be presented 
as linear functions of /3f, • • • , /??, /3* +1 , • • • , /3*_, , where 
the j8? are linear functions of ^ , • • • , f3 v and that we test the 
hypothesis = • • • = = 0. Then theorem 4.3 also applies 

to the maximum likelihood estimates &?,•••, bf, since we can 
write Q as a function of /3f , • • • , /?*_, . 

Instead of the elimination procedure of the preceding para- 
graph, it is often more convenient to employ the method of 
Lagrange operators. This method consists in differentiating 
the expression 


(4.66) Q + X.L, + • • • + \,L, = Q', 


with respect to /3i , • • • , f3 v and solving (4.65) together with 

(4 - 67) l^^ 0 ’ i=h — ,P 
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for the s + p unknown quantities di , • • • , /3„ and A„ , • • • , 
A, . The values for /3i , • • • , dp obtained in this way are exactly 
the maximum likelihood estimates b l , • • • , b p obtained under 
the restrictions (4.65). A full account of Lagrange’s method is 
given in Hancock “Theory of Maxima and Minima Chapter 
VI”. 

The regression coefficient dp in (4.6) will be termed the 
general mean if g va = 1 fo(r all a. 

Theorem 4.4: Let 


E(y a ) = (ia = Z 9i«P> • 

»-l 

Assume that 

1) /3p fs the general mean. 

2) g ia is either 0 or 1 , i = 1 , • • • , s. 

3) Z Sbalba = o if i ^ j, i, j < s. 

a 

« 

4) Z ffl = 1 a = 1, • • • , N. 

t-I 

If 

Q = Z [v« - Z ff.adi) 

is minimized ivith respect to 

8 

Pi ) * ) fiv CLTld ^ ^ = 0 , ti 9^ 0 

»-i 

is tfie only restriction on & , • • • , & , ft, and if \ x is the Lagrange 
multiplier associated with 
8 

Z Ldi then Ai = 0. 

t-1 

It may be emphasized that any number of restrictions may 
be imposed on d.+i , • • • , dp-i • Denoting by , • • • ,6, the 
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least square estimates of f) t , • • • , /3„ we obtain the following 
equations 


22 Vagi a 


V 

fr* ^ 1 £7»'a QdaQia 

a d“i+l a 


2 


= 0 , 


(4.68) ^ * ) £} 

'Ey- - E b < 22 ?i« - E h E g<“> = 

a » — 1 a d — • + 1 a 

Because of the conditions 1, 2, 3, 4 we have 

a 

2/a = V aQ i a y (/*<* ^»a > 

a a t-1 a a 

(4.69) 

a 

) . ) . QiaQda ^ ' f/d a * 
i-1 a a 

If we sum the first of the relations (4.68) from i — 1, • • • , s 
we obtain Xi = 0 on account of the relations (4.69). 


Theorem 4.5: Let 

Q = 22 (</. - 22 ?.«/3,) 2 . 

a i 

Let Q, be the minimum of Q under the restrictions 

2> = o 

»-i 

and other restrictions involving (3. +i , • • • , /3* only. Let b, , • ■ ■ , 
b. be the least square estimates of /3 L , • • • /3, under these restrictions. 
Let Q r be the minimum under the restrictions fii ~ • • • = /3, = 0 
and all other restrictions. 

If Qr ~ Qa is a symmetric function of b x , • • • , b, and if the 
assumptions of theorem 4.4 are satisfied then 


(4.70) 


Qr ~ Qa = 


s — 1 


22 


2 

<Tbi 


= Ca 


sc 
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Proof: Q r - Q a is by theorem 4.3 a quadratic form in 6, , 
• • ,b, . Since it is symmetric in 6, , • • • , 6. and since 


E b t = ft 

t'-l 

we must have 


(4.71) Q r - Q a 


h E b] + k E 
• - 1 ».»—» 


= K±b 2 i 

*- 1 


Because of the symmetry, the variances of the 6,- must all 
be equal to each other. Q r - Q a has by theorem 4.1 the x 
distribution with (s — 1) degrees of freedom. Hence 


(4.72) E(Q r - Q.) = (« - I)* 2 = Ksca 2 

and theorem 4.5 follows. 

We now proceed to present some applications of the prin- 
ciples developed in this chapter. 

Example 1. Consider a regression equation 

( 4 - 74 ) E(y) = ft + A®, 

where the values of y have been observed for certain values 
of x. For instance y may be the length of a steel rod and x the 
temperature at which this length is measured. We have then 
a set of observations 

Vi i ‘ ' > U tf 

of the variable y observed when the variable x had the values 
x i , , x N . We_ might wish to test whether A has some 

hypothetical value A . We then rewrite (4.74) as 

(4.75) E(y - A®) = A + (A - A)®. 

Treating now y tt — A®„ = y' a as the independent variable 
we may apply Theorem 4.3 to the regression coefficient A — 
A = A?. If Y'a is the regression value of y' a on A and fit and 
b* the least square estimate of /3* and c<x 2 its variance then we 
use 

p _ N- 2 bf 

1 c(E2/'„ - £ F'„) 


( 4 -76) 
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as a statistic to test the hypothesis 0* = 0. By Theorem 4.1 F 
has the F distribution with 1 and N — 2 degrees of freedom 
respectively. 

From (4.76) we can see the intuitive reason for using the 
test function F. The total observed sum of squares of deviations 

Z (Va ~ Vf where y = " N + — 
has been divided into two components; 

Z ( y« - Y a y and Z ( Y a - y ) 3 = ^ = (Q r - Q„). 

a a C 

Each of the two quadratic forms in y a divided by its rank 
(degrees of freedom) gives us an estimate of the variance c 3 . 
But whilst the estimate of a 3 appearing in the denominator of 

(4.76) is independent of the value of 0%, the numerator is an 
estimate of a 3 only if P* = 0. If /3? ^ 0 then the numerator 
will tend to be larger than a 3 . 

Example 2. Suppose now that y is again the length of a steel 
bar and x its temperature. We wish to test whether the length 
of a steel bar is a linear function of the temperature, whilst 
admitting the alternative possibility that the function be of 
second degree. Our assumption will then be 

(4.77) E(y) = /3. + + p 3 x 3 , 

where the length y of the steel bar is measured at different 
temperatures x t , • • ■ , x N . In terms of theorems 4.1 and 4.3 
we have 

Qla = 1> @2 a " X a , (?3 a = 3-a . 

The hypothesis to be tested is & = 0. The first step is then 
to estimate 0, , /3 2 , 0 3 by least squares. Then if cl, = cc 3 , 
where c can be computed from the g ia , and b 3 is the least 
square estimate of 0 3 , 

„ N - 3 b 3 3 

f = -TTq. 
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has the F distribution with 1 and N — 3 degrees of freedom 
respectively. 

Example 3. We shall consider again the one way classification 
problem treated in Chapter 3. We assumed that we had taken 
a sample of n&’s from the first classification, n 2 from the 
second and so on. Denoting by x„ the jth measurement in the 
ith class we have to consider the following linear hypothesis. 

Assumption 


E{xu) = /i< for i = 1, • • • , s, j = 1, • • • , n, . 

The hypothesis to be tested is /i, = • • • = n. . The number 
of independent linear constraints imposed by the assumption is 
«i + n 2 + • • • + n, — s = n — s. The number of linear con- 
straints imposed by the hypothesis is s — 1. To obtain Q a we 
have to minimize 

(4.78) ± E (*„ - 

*-l J-l 

Let to, be the least square estimates of /t, . Then 

(4.79) to, = -y E x a = Xi- > i = 1, • • ■ , 8. 

71 i j 


Hence if F„ is the regression value of x, f on Hi , ••• , 
we° have 


(4.80) 7„ = x,. , 


(» = !,•••,«, j = l,-*-, nt). 


To obtain Q r we have to minimize E* E> (*« — m) 2 which 
yields as regression value the mean x of all observations. It 
follows then from Theorem 4.1 and equation 4.1 that 


(4.81) 


E 2 2 

i riiXi. — nx 

s - i E*Ei ( x ‘>) 2 - Ei «,x 2 . 


is the likelihood ratio statistic for testing our hypothesis. 

Example 4. We shall now treat the problem of a 2 way 
classification. As an example suppose that r-s pigs from r 
different races receive s different diets such that exactly one 
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pig of the t'th race (t = 1, • • • , r) receives the jth diet j = 1, 
• • • , s. The purpose of the experiment is two fold. We want 
to see if the pig races differ with respect to the weight gains 
and at the same time we should like to know if the different 
diets differ in their ability to produce weight gains. 

Our observations can be arranged into a matrix 

%11 ) * * * j %la 


% rl j * * * i %r$j 

where x,, is the weight gain of the pig from the tth race which 
receives the jth diet. 

We assume now that the weight gain is produced by two 
factors, race and feed, both of which act independently of 
each other. Moreover we shall assume that the x<,- are normally 
and independently distributed all with the same variance. 

Our linear hypothesis is then the following 

(4.82) E(Xu) = Mi- + M-i + M, X) Mi- = X2 M-i = 0, 

where Mi- is the “effect” of the zth race m-> the “effect” of the 
jth diet, and n is a constant independent of i and j. 

To find Q a we have to minimize X2. ( x a ~ Mi- — M-i — m) 2 
subject to the restriction of (4.82). The conditions of theorem 
4.4 are however obviously satisfied and we may therefore ignore 
the restrictions. Thus if m v . , m., , m are the least square esti- 
mates of Mi- , M-> > M we have 

™ = ; Z X Zii = x > 

/ o i j 


rrii 


= i £ Zo- 


rn = x,-. — X, 


m.i = ^ Yj z.-i - m = x.,- - 


X. 
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Thus the regression value F ( , is given by 
(4.83) Y a = Xi. + x., — x. 

We now apply theorem 4.2 and consider the sequence of 


hypotheses 

Hi : 

Mo = Mi- + M 

(4.84) 

H 2 : 

Hi & Mi- = 0, 


H 3 : 

Hi & H 2 & M-i 


It is easily seen that the regression values are 
YtY = + x.j — x, 

(4.85) Y\f = as., , 

F‘ 3> = x. 

Hence by theorem 4.2 

Qa = X (*</ - — *•/ + a:) 2 

(4.86) 

= S *ii — s ( x >- — x) 3 — r ^ (x.,- — x) 3 — rsx 3 . 

» , j »' i 

For testing H 2 : Mo = 0 we have 

(4.87) Q r - Q a = D (Fi)-’ - F- 3> ) 3 = s £ (as,. - x) 3 . 

* , i * 

Similarly for testing H 2 : /z.,- = 0 we obtain 

(4.88) Q r - Q„ = r £ (x., - x) 3 . 

i 

We can further simplify (4.86), (4.87), (4.88) by means of (3.1) 
and applying theorem 4.1 we find that 

p (r - l)(s - 1) 

** - I i 




— rsx 3 

— r ^2 x. { + rsx 


(4.89) 
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and 


r # ( r - l)(s - 1) 


(4.90) 


r E 


Z 2 2 

x./ — rsx 



— s — r yix!, + rsx 2 


have both the F distribution and are the likehhood ratio 
statistics for testing the hypotheses H 2 : /*,. = 0, H' 2 : n.,- = 0. 
The degrees of freedom are r — 1 and (r — 1) (s — 1) for F 2 ; 
s — 1 and (r — 1) (s — 1) for F 2 . 

Problem 1. Find the proper statistic to test H l2 : n t . = n 2 . 
and H[ 2 : )u-i = M -2 in example 4. Hint; apply the corollary to 
theorem 4.3. 


CHAPTER V 


Analysis of Variance in an r-way Classification Design 

Let us again consider example 4 of chapter 4. We had rs 
quantities x., (i = 1, • • • , r; j = 1, • • • , s). The observations 
could be arranged in classes in two ways and Xu was the value 
observed in the z'th class of the first and in the jth class of the 
second classification. 

This idea can be generalized and we shall in this chapter 
consider r- way classification designs and their analysis for any 
r. For practical reasons r will be limited to at most 4 or 5; 
however, a general treatment of r-way classification designs 
is just as easy as the treatment of special cases and we shall 
give it here in all generality. 

To give an example of a 3-way classification suppose that 
we have 10 weather stations. The mean rainfall was recorded 
by these 10 stations every month in 5 successive years. Every 
observation is then characterized by 3 numbers, the number of 
the weather station, the month, and the year in which the 
observation was made. Thus the observations may be denoted 
by x aia , a , (ai = 1, • • • , 10; a 2 — 1, • • • , 12; a 3 = 1, • • • , 5), 
where a! is the number of the weather station, a 2 the month, 
and o 3 the year of observation. 

We may for instance want to know whether rainfall was 
different in different locations or in different years. Differences 
between different months are certain to be present. 

These simple questions do not however exhaust the informa- 
tion in which we might be interested. It is of interest to know also 
whether the combination of a certain location with a certain 
month has any bearing on the amount of rainfall, or whether 
rainfall was unusually large in July of a particular year. Accord- 
ingly we conceive the mean rainfall in one particular station dur- 
ing one particular month and in one particular year as being 
made up of the effects of station, month and year as well as of the 
effect of the interaction of month and year, month and station, 
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year and station and finally one effect due to the interaction 
of month, year and station. Thus 

F(X 0l0l0j ) 2, 3, d\ , &2 ) U 3 ) “f* ju(l, 2j CLi , Ct 2 ) 

(5- 1 ) + m( 2, 3; a 2 , a 3 ) + /x(l, 3; a, , a 3 ) 

+ a*( 1; ai) + m( 2; a 2 ) + m( 3; a 3 ) + # 1 , 

where 

m(1j 2, 3; ai , a 2 , u 3 ) 

01 

/*(!> 2, 3, cii , u 2 > u 3 ) — ^ 1 m(1j 2, 3; d t , u 2 , <z 3 ) 

“* a, 

M(tl ) I2 ) ®>, ) ®i a ) = » ®i, > a,,) 

“•> 

= X) /*(*1 ; a„) = 0 . 

For instance /x(l, 2; 3, 5) denotes the effect of the coincidence 
of station number 3 with month number 5. The assumption can 
also be written as 


•Pataaaa m(1> 2, 3, d\ , d 2 , U 3 ) "f" /i(l, 2j d\ , U 2 ) 

(5- 2 ) + m(2, 3; d 2 , d 3 ) + m( 1, 3; <b , a 3 ) + /*(1; aj) 

+ m( 2; a 2 ) + ^(3; a 3 ) + n 4- . 

We shall assume that the are normally and inde- 

pendently distributed all with mean value 0 and the same un- 
known variance a 2 . 

Generally in an r-way classification we shall assume that 


(5.3) 


X) fi(h j ' I b j 0/i t , ■ * ' , Uia), 

a-0 1 , 2 , • • • , r 

(®» = * * * ) ti)y 

tii 

X) m(^*1 > * y t > * * | ®»*) = 0, 

a »i-l 
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where the second summation is defined as a constant m when 
a = 0 and £ 1 .-., n(u a, J denotes sum- 

mation over all combinations i x , '• • • , chosen from 1, • • • , 
r with tj < it < ••• < i a • The quantity n(i x , ■■■ , i a ; 
a it , ■ ■ ■ , a ia ) is called an (a — l)st order interaction. 

We shall denote by x(i, ,•••,»*; o, ,•••, a*) the mean of 
all observations in class o 1 of classification i x , class a 2 of classi- 
fication it , • •• , class a k of classification i k and by .••••*» 
/(A;, , • • • , k a). The sum of all f(k x , • • • , k a ) for all choices 
fci < k 2 < • • • < k a out of *i < i 2 < • • • < ik , a < k. 

We then consider hypotheses //(f,, : udi , ••• > ** » 
a x , , a k ) = 0 for all a, , • ■ • , a* . We arrange these hy- 

potheses into a sequence as in Theorem 4.2 in such a way that 
higher order interactions precede lower order interactions. 
Interactions of the same order may be arranged in any arbitrary 
way. In computing Q r we shall first put the term resulting 
from the Lagrange multipliers equal to 0. It will then be easy 
to verify that the least square estimates for the n’s obtained 
in this way always satisfy the restrictions 5.3 and that they 
are moreover unique solutions of the min i m um problem. 
Minimizing 

Q X ax ,‘“,a r 

ai Or I— 

l 2 

— t*(i i )■"■)*«! > * ' ‘ > ®»«) 

O-0 1. •••,!■ J 

under the hypotheses considered and denoting by A(i x , • • • ,i a ; 
Oi , • • • , a.) the maximum likelihood estimate of n(i x 
Oi , • ■ • , a a) leads to the equations: 

x(i X j ' ' ' j ia t ) * ' ’ J ®*o) 

(5.4) . 

= A(k x , • • • j kp ) a kx i • • • , d k f) 

0—0 i i, •••,»« 

for all t'i , • • • , i a lor which n (i x , • • • , i a ; a., , • • ■ , «<.) is 
not 0 by hypothesis. For a = 0 we have A = x = mean of all 
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observations. For a = 1 we have x(u ; a { , ) = A(t, ; a<J + A 
and therefore A(t, ; a,-,) = x(i, ; a,-,) — x. We shall prove by 
induction that 

(5-5) 

= H ^ ^ ’ ' ■ ‘ > < a ‘« » • • • > <**,)• 

Assuming that 5.5 is true for all a' < a we proceed to prove 
5.5 for a' = a + 1. We have 

x (ii i K + 1 a<, , • • • , a,-. +1 ) 

0 + 1 

— S S -4(^1 > • • • , kp •, a tt , • • • , a t# ). 

P-0 *•.•".<« +1 

Hence 


■^(fi > • • • j t'o+i ; a,-, , • • • , fl,„ +1 ) 

= x(t, , • • • , t’a+i ; Oj, , • • • , a,-. +l ) 

a 

— 2-j; . -^(^i > • • • > kp ; a tl , • • • , o tJ ) 

(5.6) 

— *(*1 > ’ • • j ia+i ; a,, , • • • , a,-„ +1 ) 


a 




Z(-ir T 


7-0 



x(b i » ’ ' ' > by ; a bl , • • • , d by ). 

We compute now in 5.6 the coefficient of xfa , ■ • ■ , b y ; 
o-b x , • • ■ , fl6 T ). The term a:(6i , • • % , b y ; a», , • • • , a tr ) occurs 
in the last sum for every choice k x , k 2 , • • • , kp which contains 
bi by . Out of the a + 1 numbers *, , • • • , i a+1 there 

are for fixed 0 exactly 
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such choices. Hence the coefficient of x(b x , • • • , b y ; a b , , ■ 
a by ) becomes 


- s ( - 1) "’(“ + r r ) 

= (-i )“ +i - 7 - r (-i)'(“ + j ■ 7 ) 


= (-l)** 1 -*. 


This proves 5.5. 

We show next that the solutions in 5.5 satisfy the restrictions 
in 5.3. This is clear for A(l; a x ) = x(l; a x ) — x. We have by 5.6 


A(l, • • • , a + 1; «i , • • • , a«+i) 


(5.6a) 


= x(l, • • • , a + 1; at , • • • , a„ +1 ) 

a 

— E E A(ki , • • ■ , kp ; Oi, > • • • j • 


-0 !,•••, o+l 


Summing 5.6a over a x and applying mathematical induction 
we obtain 


52 A(l, • • • , a + 1; ai , • • • , a a+ 1 ) 



x(2, • • • , a + 1; a 2 , • • ■ , a a+ 0 


a 


-EE a(*, 

fl-0 2, • • • , a+1 


, kp ; a*. 



by 5.4. 

The following argument now shows that the A(i x , • • • , i k ; 
o ( , , • • • , a„) are the unique solutions of the minimum problem. 
Suppose we wish to minimize the quadratic form 

Q f — ) ) * * * ) 1 x(il J • * * / ia t toil ) ' ' * ) Qia) 

°i i “•« L 

T 

— ^2 m(^i > ‘ ‘ i ®*i > ' ’ ' > 

0-0 *!,•••,*« “ * 
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under the restrictions 5.3 and no further restrictions. The 
solution to 5.4 which as we have shown satisfy the restrictions 
are then the uniquely determined values for which Q' = 0. 
Hence if we would write out the least square equations in- 
cluding the terms resulting from the Lagrange operators we 
should still get the same solutions for the A{k k , ■ • ■ , k f ; 
a k, > • • • > a ke) since Q' can take only one minimum value. 

We apply now Theorem 4.2 to our sequence of hypotheses. 
If — Hi & H 2 & • • • & , t) , then 

yf* - * 1 * ) y<A) a / • • x 

1 °i.***,o r * a i,***,o r > * * * j Ik | j * * * , dik) • 

In 

£ £o«..» r ~ n:i.... b y 

b i fer 

each A fa , • • • , i k ; o„ , , a ik ) occurs (*,-•• t r )/(t ix • • • <,-,) 

times. Thus we have by Theorem 4.2 


(5.7) 


£ ••• £(*.,... ,J S 

a T 

- i z ^ '■ 


a-0 1,2, * * * ^t a a »i 

* , * y i a y d\ x j * * 

We replace now in the identity 5.7 x ai ... ar by 

X 0l , • • • ,Of 


£ 

• , or. 


= X, 


(5.8) 


But 


£ £ /*(*! I ■")*«) ®i, , • • • , flj.) 

a =0 1 , • • • , r 

r 

53 [-^(^1 > * * * > J &» x > " * * j flij 

a-0 1, 

A*(fl j • • • , ia J ®i, , • • • , fli„)]. 

i *« ; °i i • • • I o.) = [4(t'i , • ■ • , t a ; O) , • • • , a a ) 

M(fl j * * * * * * , U a )] 


are the uniquely determined values for which 
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52 52 A (*1 > ' ' ’ ) l o ! ‘ ) a i„)" 


a -0 1 , • • • , r 


Hence from 5.7 we obtain 


Q= £ 



52 52 #*(* i !*■*>*«» > ■ ■ ■ i 


a r 



(5.9) 



•[A(ti , ••• , i 



Mtfl » ' ' ' ) fa » l ‘ ‘ ‘ l ■ 


Besides testing hypotheses concerning sets of interactions 
m(»i , • • • i t« ; «i , • • • , a„) for all , • • • ,a a we may also wish 
to test hypotheses which concern individual interactions. In 
such cases certain sets of interactions n(i l , • • • , i a ; Oi , • • • , a a ) 
will be assumed to be equal to 0 for all , • • • , a„ . 

We shall refer to such interactions as interactions of type I. 
Other interactions n(i l , • • • , i a ; a x , • • * , a >„ ) will be unknown 
for all di , • • • , a„ . These we shall call interactions of type II. 

In one such set of interactions, however, we may wish to test 
hypotheses concerning individual values of the set and we shall 
call those interactions of type III. Equation 5.9 shows that 
for finding Q a and Q, we must put n(i, , • • • , ; a, , ■ • • , a a ) = 0 

for interactions of type I and n(i t , • • • , i a ; a x , • • • , a„) = 
^■(*1 »••■»*'«» «i »**• > <*«) for interactions of type II. We 
then have to minimize for a particular choice • , j k 

52 • • ’ 52 [AO'. , • • • , jt ; o. , • • • , a t ) 

at a* 


- mO’i » • • ' I jk ; a. , • • * , a*)] 2 
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with respect to ju(ii j • • • , jk a t , • • • , a*) under the restrictions 

mO'i ) ' ' " ! I ' ) jk I Ol > ■ ■ ■ ) ffl« > ' I ®t) 0 

a« 

and certain other restrictions imposed by assumption and 
hypothesis. 

As an example consider a three way classification and assume 
that all 2nd order interactions are 0. We wish to test the 
hypothesis that all interactions between the first and second 
classification are 0. The assumption then is 

m( 1> 2, 3; tti , a 2 , <r 3 ) = 0, 

(® i = 1, ■ ■ ■ j fi j 0-2 — 1, • • • > t 2 a, 3 = lj ■ ■ ■ > £ 3 ) • 

The hypothesis to be tested is /z(l, 2; a x , a 2 ) = 0, (a t = 1, 

... t h ) a 2 = 1, • • • , < 2 ). The number of linear restrictions 
imposed by the hypothesis is (ty — 1)(< 2 — 1)- Clearly Q is 
minimized under the assumption if we put n(iy > " ' > 
a,*, j ‘ ' * j O'ta) = A (z\ , * j fa > Ui j * j u a ) for o; ^ 2 and 
this solution also must satisfy the conditions of 5.3. Similarly 
to obtain Q r we put n(i x , • • • , f« ; a x , • • • , a„) = 

A(i X , • • ■ j fa J ) ’ ’ * ) ®a) for all fL (fl , * j fa j 1 * * > ®a) 

which are not 0 under the hypothesis. This solution likewise 
satisfies 5.3. Therefore 

Q. = £ £ Z [A(l, 2 , 3; o, , o 2 , a 3 )] 2 , 

ai a a 

= <2» + h E £ [^(1. 2; ay , a 2 )] 2 . 

fli a s 

The F statistic for testing the hypothesis is therefore: 

p = (tx ~ D(*» ~ D(fr ~ 1) 

«. - !)(<* - 1) 


U £», [A(l, 2; , q 2 )] 

2 ^ 0 , £a, £a, [A(l, 2, 3; Cli , d 2 , d 3 )] 
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Suppose now that under the same assumptions as before we 
wish to test the hypothesis >u(l, 2; 1, 1) = #t(l, 2; 1, 2). To 
find Q r in this case we would have to minimize 

U(l, 2; 1, 1) - M (l, 2; 1, l)] 2 

+ [4( 1, 2; 1, 2) - „(1, 2; 1, l)] 2 


+ Z Z [4(1, 2; a, , a 2 ) - ju(l, 2; a, , a 2 )] 2 

•fli- 2 a a — 1 




+ Z [4(1, 2; 1, a 2 ) - M (l, 2; 1, a 2 )] 2 

a t -3 


under the restrictions 


m(1> 2; dx , a 2 ) — 0, (a 2 — 1, • • • , f 2 ); 


y j m(I, 2, , a 2 ) — 0, (tti — 1, * , ti) 


where ju(l, 2; 1, 1) = *i(l, 2; 1, 2). 

It is easier to apply the corollary to Theorem 4.3 to the linear 
form m(1, 2; 1, 1) — n( 1, 2; 1, 2). We then have to find the 
variance of .4(1, 2; 1, 1) — 4.(1, 2; 1, 2). We have 

4(1, 2; 1, 1) 

= x(l, 2; 1, 1) - x(l; 1) - x(2; 1) + x, 

4(1, 2; 1, 2) 

-*(1,2; 1,2) -x(l;l) - x(2; 2) + x, 

4(1, 2; 1, 1) - 4(1, 2; 1, 2) 

= x(l, 2; 1, 1) - x(l, 2; 1, 2) + x(2; 2) - x(2; 1). 
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Remembering that the covariance between two independent 
quantities is 0 we obtain 

2 2 n 

VU(l,2il,l)-4(l,2:l,2)l — 0*(1.2;1,1) «7*(l,2il,l>*(2il) 


"t" 0x(l,2;l,2) — 2o’ J .(j,2;l,2)x(2i2) 

I 2 _i 2 

f" <Tx{ 2;2) "T C*(2;l)) 

2 _ O * (^1 ~ 1) 

f[X(l,2:l,l)-A(l,2;l,2)l — ^ 

Thus by Theorem 4.1 and 4.3 the F statistic to test the 
hypothesis /*(1, 2; 1, 1) = /x(l, 2; 1, 2) is 

„ _ (t, - 1)«2 - 1)(<3 ~ 1) Ut 3 

1 2 («, - 1) 

\A(1, 2; 1, 1) - A(l, 2; 1, 2)f 

E»» E<» [-d(l) 2, 3; di , 02 , 03 )] 

The identity 5.7 can be generalized to yield 

E*. ' ■ ■ [*(il , ' ■ ' ) ia ! 0,1 , ' ■ ' ) ®, «)] 

Qi o« 


(5.10) 


= E E r 

(3 = 0 * 1 , “fci 


^ E ••• E 

tkp afcx 


•[A(fci , • • • , fcp ; ct/t, , ■ ■ ■ , nip)] • 

To prove 5.10 we note that x{i kl , • • • , i ks , • • • , a kf ) 
may be regarded as the mean of all *(t'i , • • • , t« ;«<,,•••, «. «) 
with fixed a kt , ■ ■ ■ , a kl . Applying then the identity 5.9 to the 
quantities zfo , • • • , t'« ; «x , • • • , a«) yields 5.10, since the 
quantities A(Jc k , • • • , kp ; a kl , • • • , a ke ) in 5.10 are defined in 
terms of the x{i y , • • • , i a ; a it , • • • , a ia ). 

To facihtate the computation of sums of squares of inter- 
actions we shall prove 
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(5.11) 


23 * * ’ [^(^1 ) * 1 ik ] > * * * j &»*)] 

oi at 

= Z(-i)*- a 23 23- *“ 

*»,•••. »t °ij “i, */, •■• t,„ 


■ [*0'l t ' ’ ' I ja ) flj, I • ■ • , flia)] . 

For instance 

2 • • • 53 [4(1, 2, 3; a, , a 2 , a 3 )] 2 

«i a s 

^Lj 2, 3 , d\ J 0,2 y O3)] 

a i ai a$ 

"(EE E*(2, 3; a 2 , a 3 )] 2 

a s a 3 

-feEI E*(l, 3; a. , a 3 )] 2 

ai as 

- t* E E [*(1, 2; a, , a 2 )] 2 

a x a 2 

+ kt 2 Z [x(3; a 3 )] 2 + Ms Z 0(2; a 2 )] 2 

os a a 

+ UU 53 0(1; aOl 2 - ti t 2 t 3 x 2 . 

a x 

We shall prove 5.11 by induction. We have 
A 2 = X 2 , 53 [A(u ; a,)] 2 = Z Wh ) a.) - x] 2 

0 1 Oi 

= Z [>(ii ; Oi)] 2 - iiX 2 . 

at 

Suppose that 5.11 is true for k f < k. From 5.10 we have 
* * * 23 [-^(^1 7 * * * 1 ik ) & i x 7 * * * 7 ^»*)] 

°t‘i °t* 

3E] * * * 23 [®tfl ) ’ ) 4 j J * ’ * > &»•*)] 

°»'i °»fc 

_ Z z < *' 1 " ' *■* z ... z 

«- 0 *!,•••,** ^*1 *** £jfc a O*! aie a 

• [A(fci , * * * f k a ) dj Cx y • • • y djfc a )] . 


(5.12) 
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Applying 5.11 to 5.12 for a < k we find 

[A(ti > ’ ■ * > ft j ®ii > ' ' ‘ > ®<*)] 


(5.13) 


— [*(*i > ’ ‘ i > ®*i 

a ii a ik 

<,■ ' • • <, 


, a ii)] 2 


-z z 


0 t't , • 


t-fca 0-0 


Z (-i) 


a-0 


Z Z 


fci.* 


• z 


tk 1 • • • 


■[*0‘i » 


> 3 1 3 > 


, a,.,)] 2 


The term 

[*(ji , 


> ,?0 > 








f/ i ' ' ‘ 


occurs in this expansion as often as we can make a choice of 
the indices j x , ■■■ , j» out of indices k t , • • • , k a with 0 < 
a < k. Since the indices j 1 , • • • , jp are fixed, there remain 
k - 0 indices to choose from. With a fixed there are then 
a — 0 indices to choose out of k — 0 indices. Hence for the 
fixed a the term 


■£(./l i * J jfl 1 ®ii 


‘ ‘ ’ i a i f) 


ti, •••<«. 


occurs 



/"Y fc-fl 

— O a_(S 


times. Hence its coefficient becomes 




- Z(-1) 
0—0 



- - s (-!)<* 7 0 
= - 2 c-D‘( fc 7 ^) + 


= (i - i)'-' + (-i)‘ _? . 
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Substituting this result in 5.13 we obtain 5.11. 

An important special case arises if in an r-way classification 
design we do not take one but several observations in every 
one of the multiple classifications. Such a design may be treated 
as an (r + 1) way classification design by simply numbering 
the variables in every subclass in an arbitrary manner. We 
shall then be justified in assuming that the (r + l)st classi- 
fication has no effect on the mean value. Or n(i, , ■ ■ • , i k , r + 1; 
a ix , ■ • • , a.i , Ur+i) = 0 for all choices *i <•••<**< r + 1. 
We then have from 5.9 

E E ~ u r l E ••• EZ 

a “ 0 1, ••»,f tj, lj a a i i a i a a r + l 

IMjl y * j j a, r + 1 j Qj x y * y ®/ a ®r+l)] 

= X * * * S [«(1, ‘ • , r + 1; a x , • •• , a r+1 )] 2 

<*i Or +i 

(5.14) - < r+1 E E ~ r E-- E 

a 1 ,*" f r * * * lj r a ii a/a 

* [^Ol > * * * > jet y a>j x y * * * y ®» a )] 

= E • • • E I>(1, • • • , r + 1; , • • • , a r+ i)] 2 

ax a r +i 

^f + l * y Ty y * * * j &r)] 


= S * • • £ 0(1> • • • , r, r + 1; Oi , • • • , a r , a r+1 ) 

Oi Or +i 

- x(l, ■■■ ,r;a l , ■■■ , a,)] 2 . 

Formula 5.14 is easy to interpret. Since the distribution of 
£<■> ••• orflr+i is independent of a r+1 by assumption we obtain 
an estimate of the common variance from the sums of squares 
of deviations from the means of the observations in each sub- 
class. The number of degrees of freedom of this estimate is 
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t , ... t r (t r +\ ~ 1). The number of restrictions in our assump- 
tion is easily seen to be the same number. 

Problem 1. Under the assumptions leading to 5.14 derive the 
F statistic for testing the following hypotheses. 


H, : 

m(1, 2; 

a i y a 2 ) 0 

for all Oi 

H 2 : 

2; 

cji , a 2 ) + m(1 ; di) = 0 

for all (X\ 


CHAPTER 


VI 


The P ower of the Analysis of Variance Test 

We are considering a situation in which we know apriori 
that the cumulative distribution function of the random vari- 
ables Xi , • • • , x„ is given by a function 

( 6 -!) /(*! > • • • , , 61 , • • • , 9r). 

We wish to test the hypothesis that certain of the parameters 
d have certain specified values which for convenience we may 
assume to be 0. 

The hypothesis may then be formulated as follows 
(6-2) H : 6, = ...=*, = o. 

We test this hypothesis in the following way. Suppose it is 
possible to determine a region W in the n dimensional space 
R n in such a way that the probability that a sample Xi , • • • , 
x n will fall into W is a fixed constant a provided the hypothesis 
H is true, in symbols P(x, , ••• , x n C W\H) = a. The 
number a is called the level of significance of the test or the 
size of W. We then decide to take a sample x, , • • • , x n and to 
reject the hypothesis H if the point x, , • • • , x„ lies in W. 

If the point x l , • • • , x„ does not he in W we either accept 
H as true or make further investigations. These investigations 
may consist in taking a larger sample if the distribution in the 
larger sample depends also on 0, , • • • , 9 , . The fact that the 
region W has a fixed size if H is true assures us that, provided 
H is true, we shall in the long run make a wrong decision only 
in a of the cases, where we draw a sample. This alone is how- 
ever quite insufficient to make the test valuable. An example 
will illustrate this. Suppose a = .05 and we put numbers from 
1 to 20 into an urn and test every hypothesis by drawing a 
number from our urn. We reject the hypothesis H whenever 
the number 1 is drawn. Otherwise we do not reject it. Obviously 
the probability of rejecting H when H is true is a = .05. 
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Nevertheless the test is obviously of no value. The reason for 
this is that the probability of rejecting H when H is false is 
also only .05. Thus the test does not discriminate between H 
and'situations different from II. 

We shall denote by P{E\ H ) the probability that E will 
happen computed under the assumption that H is true. Let 
us consider another alternative situation H and denote the 
point x t , • • • , by x. Then 

(6.3) P(.x CW\H) = a 

is called the size of the critical region W and 

(6.4) P(xCW\ H') 

is called the power of the critical region W with respect to 
the alternative situation H'. The power P(x C W\H') is the 
probability of discovering that H is not true provided that H' 
is true. It is thus a function of the alternative H'. If 

(6.5) P(x C W | H') > P(* C W' \ H') 
for all regions W' for which 

(6.6) P(x C W' | H) = a 

then W is called a most powerful region of size a with respect 
to the alternative H' . If there exists a region which is most 
powerful with respect to all alternatives then it is clear that 
this region is superior to all other regions. 

Unfortunately most powerful regions with respect to all alter- 
natives do rarely exist. Thus the choice of the critical region has 
to be made on the basis of some compromise principle. It seems 
for instance reasonable to require that 

I : P(xCW\H')> a 

for all H'. A region which fulfills (6.3) and I is called an un- 
biased critical region of size a. If it also fulfills (6.5) for all 
regions W' which satisfy (6.3) and I, then it is called a most 
powerful unbiased region of size a. Most powerful unbiased 
regions do also rarely exist. 
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It may be seen from the foregoing discussion that a knowl- 
edge of the power function P(x C W \ H') = f(H') is indis- 
pensable if we want to know what a test really accomplishes 
and we shall, therefore, in this chapter derive the power function 
of the analysis of variance tests. 

In chapter one we have shown that the statistic F is computed 
from the ratio of two chi square expressions. 

2 I I 2 

2 X X + • • • + X ni 
Xl = 2 » 

<J 

. y\+ ■■■ +vl 

X2 = 2 , 

<T 

where Xi , • • • , x n , ; y x , • • • , y n , were assumed to be inde- 
pendently and normally distributed variables with means 0 
and variance <r 2 . If x, , • • • , x n , have variance <rl and y x , • • • , 
y n , variance a\ there are two essentially different hypotheses 
that may be tested by means of the F statistic : the hypothesis 
Hi : a\ = a\ under the assumption E(x < ) = !?(?/,) = 0 and 
the hypothesis H 2 : E(y x ) = 0 under the assumption a\ = <s\ 
and E(x { ) = 0. We shall be chiefly concerned with the hy- 
pothesis H 2 . 

In chapter IV we discussed tests of linear hypotheses. In 
proving theorem 4.1 we have shown that the F ratio was 
given by 

nixl 2 v\ + • • • + yl, 2 _ x\ + • • • + xl, 

F = n 2 ^’ X2 “ v 2 ’ X '~ 

where the assumption stated that 

(6.7) E{x % ) =0, (i = 1, • • • , n,). 

The hypothesis to be tested was 

(6.8) £(?/,)= 0, (i = 1, ••• , n 2 ). 

Thus the alternatives to be considered are of the form 

(6.9) H' : E{ Vi ) = 0, . 
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The critical region W for testing H was given by F > F. 
To find the power of the test it is therefore necessary to compute 
the distribution of 


( 6 . 10 ) 



under the assumption that the y< are normally distributed 
with mean value 0,- and common variance a 2 . We then have 
to derive the distribution of 

(6.11) F' « . 

Xi 

The power of the test will then be given by P(F' o > n 2 /rii F). 
Our problem will be solved if we find the distribution of F'. 
For our evaluation of (6.11) it is necessary to bring the linear 
hypothesis first into the form (6.7) and (6.8) by applying the 
transformations discussed in the proof of Theorem (4.1). 

In the derivation of the distribution of x' 2 we shall need the 
function r(z) as defined in chapter one and the function 

(6.12) B(n, m) = [ a; n-1 (l — a)" -1 dx. 

Jo 


The T function satisfies the relations r(n) = (n — l)r(n — 1), 
T(l) = 1, and r(|) = ttK Between the r and the /3 function 
the following relation holds 


(6.13) 


B(n, m) 


T(m)r(n) 
r(n + m) 


To prove this relation we compute 

r(m)T(n) = f x n ~'e~ z dx [ y m ~ l e~ v dy 
Jo Jo 

= [ [ e-^x^Y' 1 dxdy. 

Jo Jo 
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We make the substitution 

(6.14) y = «(1 — z), x = mz. 

Its Jacobian is u. The region 0<x< t »,0<2/< o °is trans- 
formed into 0<m<“,0<z<1. Hence 

T(m)r(n) = [° e~“u n+m ~ l du [' z n ~\ 1 - z) m ~ x dz 
Jo Jo 

= r(m + n)B(n, m). 


This proves (6.13). 

We proceed to derive the distribution of x' 2 - We know that 
x' 2 is the sum of, say, r squares of random variable Zi , • • • , z r 
which are independently and normally distributed with com- 
mon variance a 2 and means d, , • • • , d r • The joint distribution 
of Zi , • • • , z, is thus given by 

(6.15) p(z lt ■■■ , z r ) = ex P [“ 2 ? ? (Z< " di)2 ]‘ 

Putting 

(6.16) X = 2?E^ 


■w 7 V exp ( _ 27 [ ?' ; “ 2 ? zA1 )' 


equation (6.15) may be written as 
p(z I.’"- Zr) 

(6.17) 

= (2 x) r 

We now put 

W \ = (Ed 2 )' 1 EzA = Ezid( , 

(6.18) 

r 

Wi ==: y (i == 2, • • • , r), 
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where the matrix 


T = 


d[ 

0*21 


d[ 

Q>2r 


CL r i * * * d rrj 

is orthogonal and assume r > 1. We then have 

E(wo = (E 

(6.19) * 

E(W { ) =0, (i — 2, • • • ,r) 

because of the orthogonality of T. Furthermore 

a i a i 

Since T is orthogonal the W ,■ are independently and normally 
distributed with common variance a 2 and 


( 6 . 20 ) 


\ E W 2 = x 2 


has the x distribution with ( r — 1) degrees of freedom given 
by (1.2). The joint distribution of x and W, is therefore given 
by the density function 

P(x, W>) = TTT 7 T" (x 2 ) <r - 3>/2 


( 6 . 21 ) 


(27r) 1/2 2 (r - 1)/2 r([r - l]/2)cr 

• exp (- ^2 [v 2 X 2 + Wl - 2<rW 1 (2X) 1/2 ]). 
To obtain the distribution of 
( 6 . 22 ) 


, 2 W 2 2 

X = — + X 


W t 


x' sin 6. 


we put 
(6.23) 


X 2 = x ' 2 cos 2 e, 


a 
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The Jacobian of this transformation becomes 
— x' 2 sin 20 


cos 2 6 


x'a sin 6 


ax' cos 6 


= ax' cos 


and to the region 0 < x 2 < 00 > — ^ < 00 corresponds 

the region 0 < x' 2 <“, -t/2 < 6 < v/2. Thus the joint 
distribution of x' 2 and 0 is given by the density function 

o(x' 2 e) = — (x' 2 ) (r - 2,/2 (cos ey - 2 

' r ^or n V(\r - 11/21 

(6.24) 


exp [-Kx' 2 - 2(2 X) 1/2 X ' sin 0)]. 

If we integrate this expression with respect to 6 from — ir/2 
to ir/2 we shall obtain the distribution of (x' 2 )- To perform 
this integration we expand exp [+ (2\x ,2 ) i Sin 9] into a series. 
Since for m odd 

C r/2 


/ r/2 

-t/2 


cos' 2 0 sin” 6 d6 = 0 


we obtain 

r T/2 



/ cos' 2 0 exp [(2Xx' ) / 

sin 0] d6 


' — »/2 


(6.25) 

v ( 2x x'T 
_ (2m)! 

pr/2 

/ cos’ 

— r/2 

We have 




0 sin 2 ” 6 d6. 


du 


(6.26) 


f /2 cos' -2 6 sin 2 ” 6d6 = f (1 - u 2 ) (r “ 8)/2 (w 2 ) 

•* — t/2 

= f (1 - t,)'" 3 " 2 * 

•'O * 

= m + 1) 

_ rtlr - ll/2)T(wi + 1/2) 

r(r/2 + m) 
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On the other hand 

(2m)! = (2m)(2m — 1) ••• 3-2-1 


= 2 m rn!(2m - l)(2m - 3) ••• 5-3-1 
= ^"m! ( 2m - 1 2m - 3 5 3 /l\\ 

r(i) V 2 ' 2 ‘ " 2 ' 2 ‘ r \2// 



Hence 



cos 


0 exp [(2 Xx , 2 ) 1/2 sin 0] dd 


= Y (VY r([r - 11/2V 1/2 
^ \ 2 / m!r(r/2 + m) 

= ^y(~ ~ M V (Xx ,2 /2)" 

V 2 / fa m!r(r/2 + m) ' 

Thus the distribution of x' 2 is given by its density function 


(6.27) 


Q(x' 2 ) 



1 y ,A y (Xx ' 2/2)m 

2 X / m\T(r/2 + m) ' 


For X = 0 equation (6.27) reduces to the x 2 distribution 1.2 as 
it should. It is not difficult to verify that 6.27 also holds for 
r = 1. 

We now proceed to derive the distribution of G = \' 2 /x 
where x' 2 and x 2 are independent and x 2 has the x 2 distribution 
with s degrees of freedom. The joint probability density of 
X 2 and x ' 2 is given by 


P(x 2 , x' 2 ) 



X m (x ,2 /2) m 

m!r(r/2 + m) ’ 
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We make the substitution 

,2 _ Gz 
x ~ 1 + G’ 


2 

X = 


1 + G' 


The Jacobian of this substitution is z/( 1 + G) 2 . Thus the 
joint distribution of z/2 and G is given by its density function: 

• + 2)/2 




-( 1 / 2 ) 


(6.28) 


/ G Y X m (z/2) 
\1 + G) m!r(r/2 


m/ /0\ ( r + * + 2m— 2)/2 


+ m)r(s/2) • 


Integrating out with respect to z we obtain the density of 
the distribution of G. 


« In \ (r + 2m— 2)/2 / 1 \(«4 

- S'lrro) (rb) 


(6.29) 


X m r((r + s]/2 + m) 

m\T(r/2 + m)r(s/2) 


or on account of (6.13) 

<» In \(r + 2m-2>/2/ 1 \(*+2)/2 -,tn 

w-S'Trb) (rb) a 


(6.30) 


■[ B (l + 1)] ■ 


Let F a be the critical value of F for the level of_ significance a 
so that P(F > F a | X = 0) = a. Put r/s F a = G„. P. C. Tang 
(Statistical Research Memoirs Y.2, 1938) has tabulated the 
integrals 

(6.31) f 5 '” 1 P(G) dG, J° °‘ P(G) dG 

Jo Jo 

for various values of 3> = [2X/(r + l)] 4 and various degrees 
of freedom. This integral represents the probability P n that 
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we shall fail to reject the hypothesis 6. +1 = • • • = g t+r — q 
although it is false and some alternative 0, +1 = d, , • • • t 
6 l+r = d r is true for which 



Thus one obtains an excellent picture of what the F test will 
accomplish. Tang’s tables must also be consulted if it is desired 
to find the sample size necessary to discover alternatives with 
specified values of X with a given probability. 

The evaluation of (6.30) and (6.31) requires the knowledge 
of X and c 2 but we may use a 2 = (Q a )/g as an estimate of <x 2 . 

The assumptions of a linear hypothesis state that the given 
normally and independently distributed random variables x l , 
j x n have the same variance and means ? • • ■ , jx n satisfying 
the relations 

n 

(6.32) CijUi = 0, (i = 1, • • • , s), rank (c,,) = s. 
The hypothesis then states that 

(6.33) c.+i.iM, = 0, (i = 1, • • • , r), rank f C ” ) = s + r. 

Lemma 4.1 shows that we may assume that the c,-,- are the 
first r + s rows of an orthogonal matrix. Hence 

(6.34) £(»<-*)*- ±\ Zc.,(x, - Mi .)T 
and therefore 

(6.35) Q r -Q a = E [ ±c iiXi T. 

»-i + l L i = l J 

Suppose now that the alternative H' states that E(x,) = 
where the ji, fulfill the relations (6.32) but 

(6.36) X = d t , (* = 1, • • • , r ), X) d 2 > 0. 

1 ♦' 


Then 
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(6.37) 2cr 2 X = £d 2 = E f" Ec„m,T. 

Comparing (6.35) and (6.37) we see that we may obtain 
2o- 2 X simply by substituting into the expression for Q r — Q a 
the values £,• for x,- . This simple rule is particularly useful 
since the alternative is mostly stated in terms of the mean 
values of x, and not in terms of the linear functions (6.33) of 
these mean values. 

To illustrate the use of Tang’s tables we consider testing the 
row effects in a k by m two way classification design (example 
4 of Chapter 4). The assumption was formulated in the form 

(6.38) E(x a) = n { . + + ,.i 

with E. M.- = E? M-> = 0. The hypothesis to be tested was 

(6.39) H : = 0, (i = 1, • • • , k). 

We obtained 

(6.40) Q r - Q a = m E (*<-- *) 2 , *.,= 1 E • 

* Ttl j 

Consider now the alternative H'\ 

(6.41) E(xa) - + n-i + M, E 0. = 0, E 0? > 0- 

»' » 

Then E(x { .) = 6i + n, = M- 
Applying our rule we have to substitute in (6.40) for x {j the 
expression 0,- + n-i + M- Hence for a:,-, we have to substitute 
6i + h- Thus 

(6.42) 2<r 2 X = m E 0’ • 


I 2 E. e* 

m ka 2 


The quantity 
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can be interpreted as the mean square of the row effects ex- 
pressed as a multiple of the variance. Suppose for instance 
that this mean square is .8 a 2 and that m = 5; then <t> = 2. 
If k = 4 then the degrees of freedom for Q a are ( k — 1) 
(to — 1) = 12. In Tang’s tables* we find that for 3 and 12 
degrees of freedom respectively and for 4> = 2 the probability 
P n of not rejecting the null hypothesis is .463 if a 1% level of 
significance is used and .178 if a 5% level of significance is 
used. That is to say: If we use a 5% level of significance, we 
shall, in more than 82 cases out of 100 reject the hypothesis 
6i — 0 (i = 1, 2, 3, 4) if the mean square of the row effects is 
at least .8 times the variance. 

Tang’s tables do not only give us very valuable information 
about the results to be expected from analysis of variance tests 
but enable us also to find the number of experiments necessary 
to achieve certain results. Suppose for instance that we plan 
a two way classification design with, if necessary, more than 
1 experiment in each subclass. We wish to test on a 1% level 
of significance whether the interaction between the two classi- 
fications is 0. We are interested in alternatives for which the 
mean square of the interactions is at least .16 times the variance 
and we want to take a large enough sample to uncover such 
alternatives in at least 50% of the experiments. 

Our assumption then is 

m(1, 2, 3; i, j, k ) = m(1> 3; i, k) 

— 2, 3; j, k) = m(3; k) — 0 

for i = 1, •••,<! ',j= 1, • • • , f 2 k = 1, • • • , <3 • By (5.14) 
Qa = Hi Hi Hk [z(l, 2, 3; i, j, k) - x(l, 2; i, j)] 2 with 
tiU(t 3 — 1) degrees of freedom. From (5.9) we find Q r — Q a = 
< 3 Hi U(l, 2 ; hj)f w hh (<, - 1 )(t 2 - 1) degrees of freedom. 
Thus if n(l, 2; i, j ) = d,-, we obtain 

2<A = f 3 H H (do) 2 

» i 


*The degrees of freedom of the numerator are, in Tang’s tables, denoted 
by fi ; those of the denominator by fi . The quantity BP a = <?„/(! + G a ). 


and 


73 


4> 2 = 


2X 

(<i - 1)« 2 - 1) + 1 


tltzts 


Z, (d u y 


(ti — 1)(< 2 — 1 ) + 1 c*tiU 
We are interested only in alternatives for which 


£. £, (do) 2 


CT 2 M 2 


> .16 or 4> 2 > .16 




«1 ~ 1)(<2 — 1 ) + 1 ' 


Suppose now that t x = 2, t 2 = 5 then 'I’ 2 > .32 £ 3 . We reproduce 
below the relevant part of Tang’s table for /i = 4 and a 1% 
level of significance. We find P n as follows 


4> 


fi 

30 


1.5 


2.0 


2.5 


.570 .225 .044 


60 


.509 .165 .024 . 


For < 3 — 6 we have 4> 2 = 1.92, / 2 = 50 and this would not be 
enough to insure that 1 - P„ > 50%. For i 3 = 7 we have 
4> 2 = 2.24, / 2 = 60 and P u is approximately .51. 

Although Tang’s results give a good picture of the discrimi- 
nating power of analysis of variance tests, the question arises 
whether other tests could not accomplish more than the analysis 
of variance test does. Generally one does not know the alterna- 
tives and it is not possible to maximize the power with respect 
to every possible alternative. Therefore it will be the aim of 
the investigator to maximize some average of the power. A. 
Wald has shown that the analysis of variance test has such an 
optimum property. (Ann. Math. Stat. Vol.13 #4). 

In Chapter four it was shown that tests of linear hypotheses 
can be brought into the following form. The variables 


•^1 ) * * * ) J 


Vi ) * * * ) y* ) 2 /«+ 1 ) * ■ ’ y Vv 
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are normally and independently distributed with common 
variance a 2 . It is known that E(x t ) = 0, (i = 1, • • • , r). The 
hypothesis to be tested is 


(6.43) E(y<) = 0, (* = 1, • • • , •). 

The critical region W 0 in the analysis of variance test is 
defined by 


(6.44) 



y±± 

xl + 


+ y 2 . 


+ X, 


> C. 


That is to say the hypothesis (4.43) will be rejected if G > C. 
From (6.29) we see that the distribution of G depends only on 



where E(y<) = 0< . Hence we may denote the power of the 
region (6.44) with respect to the alternative 

E(y<) = 0< , (*-!,■■•, a); E[(y t - 0.) 2 ] = E[(x<) 2 ] = <r 2 


by P 0 (X). 

Let W be another critical region and denote its power function 

by 

P(0, , , 6 P , a). 

Consider now in the p-dimensional space z t , • • • , z v the 
surface S defined by 

(6.45) 2Xcr 2 = z\ + • • • + z 2 , », = 9 t , (i = s + 1, • • • , p) . 

Let P(X, <j, d, +1 , ■ ■ • , 8 V ) denote the average power on the 
surface defined by (6.45). That is to say 

P(X, a , 0,+i , • • • , 0,>) 


(6.46) 


= (j dA^j P(z, , ,z. , e. +l 


tr) dA. 


Wald proved that for all W of the same size as W 0 
(6.47) P(X, a, d.+i , • • • , e„) < P 0 (X). 
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Thus the power of the analysis of variance test is higher 
than or equal to the mean power over the surface (6.45) of 
any other test on the same level of significance. 

Clearly if P(0, , ■ ■ • , d, , a) depends only on X then P(X) = 
P(X) and it follows from (6.47) that 

(6-48) P(X) < P 0 (X). 

The inequality (6.48) had been previously obtained by P. L. 
Hsu (Biometrika, Jan. 1941). 

The proof of Wald’s theorem is beyond the scope of this 
book. Wald’s and Hsu’s results however may be taken as a full 
justification for the use of the analysis of variance in testing a 
linear hypothesis. 


CHAPTER VII 


Latin Squares and 
Incomplete Balanced Block Designs 

Suppose that m varieties of wheat are to be compared as to 
their mean yield on a certain type of soil. We have at our 
disposal a rectangular field subdivided into m 2 plots. However, 
even if we are careful in the selection of our field, differences 
in soil fertility will occur on it. Thus if all the plots of the first 
row are occupied by the first variety, it may very well be that 
the first row is of high fertility and we might obtain a high 
yield for the first variety although it is not superior to the 
other varieties. We shall be less likely to vitiate our compari- 
sons, if we replicate every variety once in every row and at 
the same time randomize the position of the varieties within 
the rows. We might for instance take m cards with the numbers 
1, • • • , m on them, shuffle them well and then lay them out 
in a row to determine the position of the varieties in the first 
row. Repetition of this process will yield the position of the 
varieties in the second row and so forth. An arrangement of 
this type is called a randomized block arrangement. A mathe- 
matically rigorous treatment of this arrangement is at present 
not yet available. An approximate test of varietal effects is 
possible by treating the arrangement as a two-way classification 
design ignoring the variation of soil fertility within the rows. 
We shall discuss this design in detail in Chapter XII. A better 
plan will be the systematic elimination of soil fertility differ- 
ences, which is preferable to randomization and should be 
applied whenever it is possible. It yields in most cases more 
efficient estimates of the varietal effects and has the great 
advantage that a mathematically rigorous treatment is avail- 
able. 

The line of attack in our particular example is as follows. 
We conceive of the mean yield E(y iik ) of the fcth variety on 
the plot in the fth row and jth column of the field as given by 
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E(ynk) = Hi + Vi + p k + p, 
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(7.1) 


Z m.- = Z v i = Z p* = 0. 

» i k 


This assumption is for instance always satisfied if the soil 
fertility is a linear function of the coordinates, an assumption 
which is likely to be true if the field is not too large and is 
homogeneous in appearance. The quantities p,- , v f , Pk are 
called the row, column, and varietal effects respectively. The 
design is called a Latin square if every variety is planted once 
in every row and once in every column. The expected value 
of the mean yield of the fcth variety in our experiment is then 
by (7.1) equal to 

~ Z E(y iik ) = Pt + p 

where the summation runs over all pairs i, j for which y iik is- 
defined. Thus 


provides an unbiased estimate of p k + p. Since every variety 
occurs once in every row and once in every column, the mean 
y of all yields provides an estimate of p so that the varietal 
effects p* , (k = 1 , • • • , m) can be estimated. 

The assumption of our linear hypothesis is therefore that the 
Uuk are normally and independently distributed all with the 
same but unknown variance cr 2 and that their expectations are 
given by (7.1). Note that as soon as i and j are fixed k is de- 
termined by our design. The parameters n Uk = E(y ijk ) are 
expressed by the 3m + 1 parameters v t , p, , p k , (f, j, k = 1, 
• ' ‘ , m) and p. However, these parameters are not independent 
since 

Z Pi — Z v i = Z Pk = 0. 

* i k 

Hence there are 3m — 2 independent parameters and Q a will 
therefore have m 2 — 3m + 2 degrees of freedom. The hypotheses 
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to be tested are manifold. In the first place, we might wish to 
test whether the varieties differ at all from each other, we shall 
then test the hypothesis p, = 0 (i = 1, • • • , m). Or we may 
wish to test the difference between two varieties, say p, and 
p 2 . The hypothesis to be tested is then Pi = p 2 • Also we might 
wish to test whether the rows (or columns) have any effect. 
We then test the hypothesis pa = 0 (or r, = 0), (t = 1, • • • , m) 
and so forth. We shall first derive Q a . The design obviously 
satisfies the conditions of Theorem 4.4 with respect to each of 
the three sets of variables p, , v, , p* . Hence in finding Q a we 
may by virtue of theorem 4.4 ignore the restrictions’ in (7.1). 
Minimizing 


Q = ZE (Vm b “ - v,- — p 4 — p) 2 

» i 

with respect to p f , v,- , p k , p and denoting our estimates of 
these quantities by p, , j q , p* , p we obtain 

P = t Z Z = 2/, 

in j | 

Mi = ~ Z2 Vuk - y = 2/i • • - y, 

I'l' i , k 

(7.2) 

^ 22 2 /i/* - 2/ = 2 /m- - y, 

™ i.k 


Pt = ^ 22 2/i y* - 2/ = 2/ ■ •* “ 2/- 

” l/ i , j 

Because for instance the fth row contains every variety and 
every column exactly once so that the varietal and the column 
effects will cancel out. Thus 

(7.3) Qa = 22 22 (2/i it - !/.•• - 2 hi- ~ 2/ - •* + 2?/) 2 . 


79 


We now apply theorem 4.2 taking H x equal to the assumption, 


H 2 : 

II 

•>s> 

O 

II 

£ 

■ • , m), 

H 3 : 

*-,• = oo = i,- 

• • , m), 

Hi : 

T — 1 

II 

o 

II 

a 

• ■ , m). 


Then 

Z 2/iit = Z V>* ~ Vi- ~ V-i- ~ y--k + 2 2/) 2 

+ m Z V-- ~ 2/) 2 + m Z Vi- _ J/) 2 

+ m Z (?/--*= - J/) 2 + mV. 

The same decomposition is also obtained, however, if we re- 
number the hypotheses H 2 , H 3 , H t . Thus the hypothesis 
Hi : p k = 0 is to be tested by 

_ m 2 — 3 m + 2 

F = : 

m — 1 

(7.4) 

m Z y--k - m V 

Z Z y 2 uk - m[Z 2/<-- + Z y 2 -i- + Z i/ 2 -J + 2m V 

i i i i * 

The expressions for testing row and column effects are entirely 
analogous. To test the hypothesis pi = p 2 we apply formula 
(4.64). We have p, - p 2 = y.. x - y.. 2 ■ Now y.. x and y.. 2 are 
independent quantities each a mean of m independent ob- 
servations, thus 


2 


2 

= OV.a 


a_ 

m 


and therefore 


2 

G (tf. . i-V. . a) 


2^ 

m 


Hence to test H: p x = p 2 we have to use 

m 2 — 3m + 2 m(y..i — y.. 2 ) 2 


F = 


2Q a 


(7.5) 


1 
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Similarly if we test H: p x = 0 we have first to compute the 
variance of p x = y..i — y. We have 

2a + a\ 

_2_ , 1 \ o- 2 to — 1 

m m J m m 

17.6) F -- m — ^ . m . (V" 1 ~ y) 2 

1 m — 1 Q a 

is the likehhood ratio statistic for testing H: p, = 0. 

The treatment of experiments set out in several, say r, 
replications each of which constitutes a Latin square does not 
offer any particular difficulty. The observations may be denoted 
by yui where l is the replication number. The assumption states 

E(yul) — + Vj l> + Pk + «(i) + y, 

(7.7) 

So! 1 ’ = Er!” = Zp*= Z«(d = o. 

» i k l 

The number of independent parameters is 

r(m — 1) for row effects, 

r(m — 1) for column effects, 

(to — 1) for varietal effects, 

(r — 1) for replicates, 

1 for mean. 

Hence the number of degrees of freedom for Q a becomes (to — 1) 
(rro — r — 1). 

It is often possible to test at the same time other effects on 
the yield, for instance we might be able to apply to different 
fertilizers and to construct a design which forms a Latin square 
with respect to fertilizers and varieties each and has in addition 
to this the property that every fertilizer is applied exactly once 
to every variety. For to = 4 one could use for instance the 
design 


2 _ 2 



Hence 
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Vifi 

Vifi 

Vifi 

Vifi 

Vifi 

vji 

Vifi 

Vifi 

Vifi 

Vifi 

vji 

Vifi 

Vifi 

Vifi 

Vifi 

vji 


where v x , v 2 , v a , t> 4 denote the 4 varieties, fi ,f 2 , f 3 , f* denote 
the 4 fertilizers. 

This idea can be generalized to test the effects of r different 
categories of conditions for each of which there are m possi- 
bilities. We then need designs with the following properties. 
There are r different letters. Each of these letters occurs m 
times with each of the indices 1, • • • , ra. They are to be ar- 
ranged into a square, divided into m 2 subsquares, in such a 
way that the indices on each letter form a Latin square and so 
that each pair of letters occurs with each pair of indices exactly 
once in one of the subsquares. A design of this type is called a 
set of r orthogonal Latin squares. 

The analysis of these designs is entirely analogous to that of 
the Latin square design. The required F statistics can easily be 
obtained by applying Theorem 4.1. 

If the assumptions made for the analysis of the Latin square 
are justified then the Latin square is the best design for field 
experiments, which is at present available. However, it is 
necessary in a Latin square that the number of experiments on 
each variety be equal to the total number of varieties in- 
vestigated. Thus if the number of varieties is large the number 
of replications becomes likewise large. This means not only an 
unduly large expense for the experiment but also necessitates 
the use of large blocks, so that the assumption (7.1) which 
underlies the analysis of the Latin square is not even approxi- 
mately fulfilled. We shall therefore discuss other designs which 
take care of this situation. 

If we plant the varieties in relatively small blocks we may 
assume that the soil fertility is the same for each plot in the 
same block. 
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Thus again making the assumption that the mean yield is a 
linear function of varietal effect and block effect we have 

(7.8) £%,-,) = Vi + 6, + n, 22 v i = 22 h — 0, 

» i 

where ?/,■,■ is the yield of the experiment which consists in plant- 
ing the ith variety on a plot of the ith block. Applying the 
likelihood ratio principle to the linear hypothesis (7.8) we have 
to minimize 

(7.9) Q = 22 (y« - - b, - M) 2 , 

i , J 

where 22«.» runs over all pairs i, j for which the ith variety 
occurs in the yth block, with respect to t>,- , b, and n under the 
restriction 2^. v t = 22 < 6, = 0. Minimizing Q and denoting 
least square estimates by carets leads to the equations 

22 Va = r $i + 22 kfii + Nn, 

i , i i j 

(7.10) Vi = rA + £ (i) 8, + r£, 

Bj = 22 (,> + k/bj + kjn 

since by Theorem 4.4 the restrictions 22 v < = 22 bj = 0 may 
be ignored. In (7.10) 

Vi denotes the sum of the yields of the ith variety, 

Bj denotes the sum of the yields in the jth. block, 
r,- denotes the number of replicates of the ith variety, 
fc, denotes the number of plots in the jth block, 

22(0 bj denotes the sum of the effects of all blocks, which con- 
tain a plot with the ith variety. 

22 ( ’V denotes the sum of the varietal effects of all varieties 
that occur in the ith block. 

N is the number of experiments. 

In order that such a design be really useful, the following 
requirements must be fulfilled: 

1.) The solution to the system 7.10 must exist and must be 
unique. 
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2. ) It must be possible to compute the solutions to 7.10 
within a reasonable time. 

3. ) The estimates of the varietal effects should be reasonably 
accurate. 

The Vi and B, are linear functions of the observations. Hence 
if the ya are normally distributed, then each f),- , £,- , n will 
be normally distributed. 

The size of the resulting confidence interval for v { is then 
exactly proportional to its standard deviation. The requirement 
3 is somewhat vague. Suppose every variety occurs the same 
number of times and it would be possible to carry out an ex- 
periment in a two by two classification according to blocks 
and varieties with a complete replication in every block. In 
such a design the estimate would then have a certain variance 
a 2 /h. Suppose the variance of 0, as computed from (7.10) is 
<x 2 /Ci . Then 



is called the efficiency factor of the design leading to (7.10) 
with respect to the estimate . The efficiency factors with 
respect to varietal differences are defined similarly. Clearly if 
there is a choice between two designs one of which is more 
efficient than the other whilst both justify the assumption 
7.8, then the experimenter will choose the more efficient design. 

Various designs have been constructed which satisfy the 
requirements 1 and 2 and the requirement 3 to a fairly satis- 
factory extent. The best of these are the incomplete balanced 
block designs. These are available for certain combinations of 
the number of varieties and number of replications. 

A balanced block design is an arrangement of v varieties 
into b blocks of k plots each such that 

1. ) No block contains the same variety twice. 

2. ) Every variety is replicated r times. 

3. ) Every variety i>< occurs with every other variety in- 
exactly X times together in the same block. 
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The total number of experiments is bk on the one hand and 
rv on the other hand so that 

(7.12) b-k = r-v. 

Every variety Vj occurs i'j r blocks. These r blocks contain 
r{k — 1) varieties different from . Since every v t ^ t>,- occurs 
among them exactly A times 

(7.13) r(k — 1) = \(v — 1). 

Equations 12 and 13 are necessary conditions for the existence 
of a block with the parameters b, v, r, k, A. Another necessary 
condition for a design in which not every variety is repeated 
in every block is 

(7.14) b > v. 

The condition (7.14) was first proved by R. A. Fisher, Ann. 
of Eugenics (1940) 10 pp. 52-75, and will be derived later. The 
conditions (7.12), (7.13) and (7.14) are not sufficient for the 
existence of the design. Thus for instance the design v = b = 43, 
r = fc = 7, A = lis known to be impossible. In fact necessary 
and sufficient conditions are at the present time not yet known. 
Various methods for the construction of incomplete balanced 
block designs will be given in the next chapter. 

We proceed to discuss the analysis of balanced incomplete 
block designs and note first that in 7.10 = r, k,- = k. Hence 

on account of ]T\ Vi = 6,- = 0 7.10 reduces to 

X Va = mi, 

« . i 

(7-15) Vi = ri>i + Tim bj + rn, 

Bj = 2Z <,) + kbj + kp. 

We put Ti = 2, 0 Bj = sum of the totals of all the blocks 
which contain the tth variety. Summing the third equation in 

(7.15) over all blocks containing the ith variety we obtain 

(7.16) T { = k 23(0 bj + (r — A)^ + rkn 
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since 22 > 0,- = 0 and since every variety different from occurs 
in the sum X times whilst v { occurs r times. Multiplying the 
second of the equations (7.15) by k we obtain 

(7.17) kV i = k 22(o h/ + rfc0< + rfcju. 

Subtracting (7.16) from (7.17) we get 

(7.18) (rfc - r + X)fl 4 = *F 4 - 7\ . 

Substituting from (7.12) and (7.13) 

rk — r + X = r{k — 1) + X = \(v — 1) + X = \v. 
Hence 

M = V, 

(7.19) 6i = ~ (fcF 4 — T { ), 

l ‘-~k «< - 55 - iv> - 

We observe that (fc — 1)F,- and — F, are independent 
quantities and therefore 

4 = X¥ [{k ~ 1)V + r(fc - !)] 

(7.20) 

_ rfc(fc - 1) _ fc(t> — 1) 

XV “ Xu 2 ‘ 


We now apply Theorem 4.2 to the sequence of hypotheses 
Hi : E(yi,) = Vi + b,- + n, H 2 : v { = 0 (i — 1 , • • • , v ), 
H z : bj = 0 (j = 1 , • • • 6 ). 

Then 

Q° = 12 2/0 - 1 12 -B? - 22 - y 22'” »<) , 

% , i i » , j \ I* / 


Qr = 22 rf, -I Zb*. 


(7.21) 
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On account of the conditions of an incomplete block design 
the expression for Q, — Q a is symmetric in the v { , (i = 1, 
• • • , a). Hence by Theorem 4.5 and on account of 7.20 



(7.22) 



To carry out tests of significance for the hypothesis a ( = a,- 
it is necessary to know the variance of — D, . We have 



(7.23) 


Now tu and a, are given by (7.19). Counting the observations 
common to the terms in (7.19), we find no common observation 
in Vi and V,- , X common observations in F, and T, or F, and 
Ti and fcX observations occurring in r l\ as well as in T, . Thus 


XVc t({J = (~k\ — fcX + k\)a 2 = — k\a 2 


and therefore 


2 


2 k(v — 1) . 2k 2k 
\v 2 + Xi> 2 “ \v ' 


(7.24) 


2 


Application of the corollary to Theorem 4.3 then yields the 
proper test statistic for testing the hypothesis v { = a, . 

To find the efficiency factors with respect to 0; and A — a,- 
we have to compute the variance of the estimates a,- , a, — 0,- 
in a two-way classification design with r replications and these 
are easily found to be a — 1/rv and 2/r respectively so that 
in both cases the efficiency factor is \v/rk. This is mostly quite 
satisfactory, as for instance in the designs 


(a, b, r, k, X) = (16, 24, 9, 6, 3), (8, 14, 7, 4, 3), 


(11, 11, 5, 5, 2) or 


(21, 21, 5, 5, 1). 


CHAPTER VIH 


Galois Fields and Orthogonal Latin Squares 

It was seen in Chapter VII that the analysis of sets of 
orthogonal Latin squares and of incomplete balanced block 
designs offers no particular difficulty. The construction of 
these designs however leads to very interesting combinatorial 
problems, some of which are not yet completely solved. 

A Latin square of side m is an arrangement of m letters into 
to 2 subsquares of a square in such a way that every row and 
every column contains every letter exactly once. Two Latin 
squares are termed orthogonal if, when one is superimposed 
upon the other, every ordered pair of symbols occurs exactly 
once in the resulting square. Thus the Latin squares 

ABC a p y 

B C A y a P 

CAB P 7 a 

are orthogonal. The problem of constructing, for instance, a 
set of r orthogonal Latin squares of side m could be regarded 
as solved if we either can give a method by which such a de- 
sign can be constructed or are able to prove that the design 
cannot exist. This problem is at present still unsolved for many 
combinations of r and m. Various methods have been dis- 
covered however for obtaining solutions in a great many cases. 
In fact, within the range useful in the design of experiments, 
the solution has been obtained for most cases with only a few 
exceptions. The experimenter will usually not go beyond m = 
13. The problem of the construction of orthogonal Latin squares 
within this range is solved for m = 2, 3, 4, 5, 6, 7, 8, 9, 11, 13. 
That is to say, (m — 1) orthogonal Latin squares of side m 
can be constructed for m = 2, 3, 4, 5, 7, 8, 9, 11, 13 while it 
is proved that no six-sided orthogonal pair exists nor more 
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than (m — 1) orthogonal Latin squares of side m. An orthogonal 
pair of side 12 can be constructed, but it is not known whether 
a pair of orthogonal 10 sided squares or a triple of orthogonal 
12 sided squares exists. 

To understand the methods by which orthogonal Latin 
squares have been constructed we need certain elementary 
concepts of algebra and of the theory of numbers which will be 
developed presently. 

Let a, b, m be integers. We shall write 

(8.1) a = b(m) 

in words, a congruent to b modulo m, if m divides a — b. Such 
congruences can be treated like equations. For instance if 
a = b(m), then a ± c = b ± c(m), ac = bc{m). The proof of 
these two propositions is left to the reader. If also c = dim), 
then ac = bd{m), a ± c = b ± d(m). 

Proof: According to our definition we have 

a — b = \/m, c — d = X 2 m, X, , X 2 integers. 

Hence ac = bd + m(X 2 b + \,d) + X,X 2 m 2 and therefore 

(8.2) ac = bd{m). 

The relation a db c = b ± d(m) follows in a similar manner. 

The rules for division of congruences are not so simple. We 
shall prove however the following rule: 

If ac = be (to) and t = ( m , c) is the greatest common divisor 
(g.c.d.) of m and c then 

(8.3) a ^ b(j). 

Proof: ac — be = \m, X integral. Hence 


.s , Xm X m 

(8.4) . - 6 - — - Jr; ■ J . 

The left side of (8.4) is an integer. Since m/t and c/t are integers 
and c/t is prime to m/t, it follows that X is divisible by c/t. 
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Hence X/ ( c/t ) is an integer and m/t divides a — b. In particular 
it follows that we may divide a congruence by any number 
which is prime to the modulus. If m is a prime number p then 
we may divide congruences mod p by any number a such 
that a ^ 0 ip). 

In the following we shall always calculate mod p. That is 
to say, we shall replace every number by its smallest positive 
residue mod p. For instance 4 + 2 = 1(5), 2.8 = 1(5) and 
so forth. 

Let p be a prime number and form the following design. 

0 \---p— 1 

j 1+j- • -p—l+j 

(8.5)L f = 2 j l+2j- • -p— l+2j j=l,---,p—l 


(p-i)j i+(p-i)i- • -(p-i)+(p-i)j. 

All numbers in L, are reduced mod p. We shall show that L, 
is a Latin square. If this were not true, then since only the 
symbols 0, 1, • • • , p — 1 occur in L,- , we would have some 
row or column in which one of the symbols occurs twice. If 
the fth row contains the same number in the fcth column and 
in the rth column we should have 

k + ij = r + ij(p), 
k = rip). 

A similar argument shows that every column contains every 
number exactly once. Thus L f , (j = 1, • • • , p — 1) is a Latin 
square. We shall show now that L, is orthogonal to L, if i j. 
If this were not the case, we should have the same ordered 
pair of numbers occurring in two different boxes of the square 
which results from superimposition of Li on L,- . Let mn be a 
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pair which occurs twice and assume that it occurs in the ath 
row and (3th column and in the 7th row and 5th column. Then 

|3 + aj = 5+7 j = m(j)), 
fi + at = 5 + yi = n(p). 

Hence 

a(i - j) = 7 O' - j)(p). 

But — p < (i ~ j) < V and (i — j) is therefore prime to p. 
We may therefore divide by i — j and obtain a = 7 (p), 

P - «(P)- 

As an example we present a set of 4 orthogonal 5 sided 
squares. 


Li 

U 

U 

l 4 

0 12 3 4 

0 12 3 4 

0 12 3 4 

0 12 3 4 

1 2 3 4 0 

2 3 4 0 1 

3 4 0 1 2 

4 0 12 3 

2 3 4 0 1 

4 0 12 3 

1 2 3 4 0 

3 4 0 1 2 

3 4 0 1 2 

1 2 3 4 0 

4 0 12 3 

2 3 4 0 1 

4 0 12 3 

3 4 0 1 2 

2 3 4 0 1 

1 2 3 4 0 


If we consider the properties of the system of residues mod p 
which were used in constructing the L,- we note that, partic- 
ularly, the uniqueness of the division was necessary. Because of 
the uniqueness of the division the residues a, 2 a, • , (p l)a 

are ( p — 1) different residues all different from 0 provided 
a ^ 0(p). Hence one of them must be the residue 1. Thus to 
every residue a ^ 0 (p) there exists a residue a -1 called the 
inverse of a such that a -a -1 = l(p). 

From our method of constructing m — 1 orthogonal squares 
if to is a prime number, it may be surmised that we can always 
construct to — 1 orthogonal Latin squares if we have a system 
55 of w elements satisfying the following conditions. 
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To every 'pair of elements a, b in $ there exist two uniquely 
determined elements a + b and a-b in The “addition” and 
“multiplication” satisfy the following conditions : 

I. a + b = b + a, ab = ba, The commutative law. 

II. (a + b) + c = a + (b + c), ( ab)c = a(bc ), The 

associative law. 

III. There exist two elements 0, 1 in 5 such that 

a + 0 = a a-1 = a 

for every a in 

IV. To every a ^ 0 there exists an element (—a) and an element 
a -1 such that 

a + ( — a) = 0, a-a _1 — 1. 

The element a -1 is called the inverse of a. 

V. c(a + b) = ca + cb, The distributive law. 

A system satisfying the postulates I — V is called a field. If 
the number of elements, which we shall call the marks of the 
field, is finite, then it is called a finite field or a Galois field. 
It may be remarked that the commutative law of addition, 
and, if the field is finite, also the commutative law of multi- 
plication need not be postulated. 

Let g 0 = 0, g x = 1, g 2 , • • • , g m ^ l be the elements of the finite 
field g and form the designs: 


0 

1 

Qm— 1 

9< 

ffi + 1 

Q i~" 1” Qm— 1 

{ UQi 

g^+l 

Q iQ2~\~ Qm— 1 


(8.6) Li= • • • (i = 1, • • • , m — 1) 


(JiQm—l q ifim-l 1 ' * * J7t 1 "L 1 • 
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Then by exactly the same argument that was applied in the 
case of the field of residues mod m we can show that L, , • • • , 
L„_x is a set of to — 1 orthogonal Latin squares. Hence we 
have 

Theorem 8.1: If g 0 = 0, g x = 1, g 2 , • • • , g m - 1 are the marks 
of a finite field, then the designs L { of (8.6) form a set of m — 1 
orthogonal Latin squares. 

In a field g the following propositions hold: 

Proposition 1: a-0 = 0 for every a. 

Proof: a = a(l + 0) = a + a-0; adding (—a) -to both sides 
of this equation we obtain Proposition 1. 

Proposition 2: ah = 0, a 0 implies 6 = 0. 

Proof: This follows by multiplying ah = 0 with a -1 . 

We denote by m-x where m is an integer and x a mark of 
% the sum of mi’s. We then have 
Proposition 3: If m is an integer such that m- 1 = 0 then 
m-x = 0 for every x. If mx = 0 for one x ^ 0, then my = 0 
for all y in g. 

Proof: If wl = 0 then mx = ( m-\)x = Ox = 0. Also if 
mx = 0 then mx = (m-l)x — 0 if x 0 then by Proposition 
lffl-1 = 0 and therefore m-y = 0 for every y. 

Proposition 4: Let p be the smallest positive integer for which 
p- 1=0 then p is a prime. (Such an integer need, of course, 
not exist.) 

Proof: Suppose p = mn, m < p, n < p then mn-1 = 
(m-1) (n-1) = 0. Hence either m- 1 = 0orn-l = 0 contra- 
dicting the significance of p. 

The number p is called the characteristic of the field. If there 
is no integer p for which p ■ 1 = 0 then the field is called a field 
of characteristic 0 and is necessarily infinite because the ele- 
ments n- 1, n = 0, 1, • • • ad. inf. are then all different. 

Theorem 8.2: The number of elements in a Galois field g is a 
power of its characteristic p. 

Proof: Put w x = 1. If there is a mark w 2 ^ a - 1 for a = 0, 
• • • , p — 1 form all marks a^x + a 2 w 2 , ax = 0, 1, • • • , p — 1; 
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a 2 = 0, 1, • • • , p — 1. These are p 2 different marks. If they 
do not yet exhaust all the marks of g then take a mark w 3 
different from a k w k -f- a 2 w 2 and form all marks a 1 w 1 + a 2 w 2 + 
a s w 3 . Continue the process until all marks of % are exhausted. 
If «>, , • • • , w m are obtained in this way, then a l w l + •••-(- a m w m 
(o, = 0, 1, • • • , p — 1) represent all the marks of g. If 

(8.7) a.w, + • • • + a m w„ = b k w k + • • • -f- b m w m 

then (a t — b 1 )w 1 + • • • + (a„ — b m )w m = 0. Let k be the 
largest number for which a k — b k = — c k ^ 0. Then 

c k w k = (a, - + • • • + (a*-i - . 

Let c k 1 be the inverse to c k in the field of residues mod p then 

Wk = c k l (a i — b^Wi + • • • + cl l (a k -i — b k _^)w k - k 

= d l w l + • • • + d*_ iW*_i 

where d k , • ■ • , d k - k are residues mod p. But this contradicts 
the significance of w k . Hence 5 contains p m elements. 

Let a be any mark of a Galois field, G.F.(p m ), and form 
1 , a, a , • • • , a, • • • . Since the number of marks is finite we 
must have for some k > j 

k I k-i 1 

a = a , a =1. 

Definition: If t is the smallest positive integer such that a = 1, 
then t is called the order of a. 

Let Xi , • • • , , be all the non-zero elements of G.F.(p m ) 

then 

<xx 1 a£ 2 ■ • ■ ax p m^ 1 = x k • • • if a ^ 0. 

Hence 

(8.8) a” ~ l = 1 for all a ^ 0. 

We shall prove now several propositions on the order of 
elements of a finite field 

Proposition 5: If s is the order of a and a n = 1, then n = 0(s). 
For we can find an integer X such that n = Xs + r, 0 < r < s, 
and a” = 1 implies a = 1, hence r = 0, since s is the order of a. 
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Corollary: If s is the order of a then p m — 1 s= 0(s). 

Proposition 6: If a has the order s and P the order t and ( s , t) = 1 
then a-p has the order st. 

Proof: (aP) r = 1 implies p ,r = 1 and sr = 0 (<) by Proposition 
5. Hence r = 0(<) and similarly r = 0(s). Thus r = 0(st). But 
(aP)“ = 1 and st is therefore the order of a-p. 

Proposition 7 : If a has the order Xju then a x has the order u- 

The proof is left to the reader. 

Proposition 8: If s is the largest order occurring in a Galois 
field 5 and if t is any order then s = 0(t). 

Proof: If s ^ 0(t) then for some prime p we should have 
s = p’r, t = pV, (p, r) = (p, r') = 1, / > e. If a has the order 
s and P the order t, then by propositions 6 and 7 a v 'p r ' has 
the order p' -r > s, but this contradicts the significance of s. 

Definition: A mark of order p m — 1 in the Galois field of order 
p m is called a primitive root. We are now prepared to prove 

Theorem 8.3: A Galois field G.F. ( p m ) of order p m , has 
<t>(p m — 1) primitive roots, where 4>{n) denotes the number of 
residues mod n which are prime to n. 

Lemma 8.1: A polynomial P(x) = x" + a 1 x n ~ 1 + ••• + a n 
of degree n with coefficients in G.F.(p m ) has at most n roots. 

Let a be a root of P(x). Then P(a) = 0. Hence 
P(x) = P(x) ~ P(a) 

= x n — a" +••■ + a»-i(z — a) = (x — a)Q(x) 

where Q(x) is a polynomial of degree ( n — 1) with coefficients 
in G.F. (p m ). If p is a root of P(x), then by Proposition 2 either 
P = a or Q(P) =0. Lemma 8.1 then follows easily by induction. 

Proof of Theorem 8.3: Let s be the largest order occurring in 
G.F.(p m ). Then since every order divides s we must have for 
every a in G.F.(p m ) 

(8.11) <x‘ = 1. 

By lemma 8.1 it follows from (8.11) that s > p m — 1 but 
also p m — 1 = 0(s) and therefore p m — 1 = s. Thus there 
exists at least one primitive root. Let w be this primitive root, 
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then w' where i is prime to p m — 1 is also a primitive root. 
Hence there are <t>(p m — 1) primitive roots. 

If a primitive root is known then the construction of a set 
of (m — 1) orthogonal Latin squares can be simplified con- 
siderably. Let w be a primitive root and 0, 1 , x 3 , • • • , x„ be 
the elements of a finite field of order n then 


0 

1 

• • X n 


w 0+i 

l+w 0+i ■ 

■ ■ x n +w a+i 


(8.12) U = w 1+i 

l+w 1+i • 

•• x„-\~w l + ' (f = 0,1, • 

2) 

U)" _2 + ‘ 

l+U)"- 2+< • 

• • x n +w n ~ 2+i 



are n — 1 orthogonal Latin squares. It should be observed that 
L, +1 is obtained from L, by cyclically permuting the last n — 1 
rows. 

We now proceed to construct a G-F^p™) for every m and 
every p. If m = 1 then the residues mod p form a G.F.(p). 

We consider polynomials 

p(x) = x n + a^" -1 + • • • + a„ 

whose coefficients a, , • • • , a„ are elements of a field. We shall 
prove: 

Theorem 8.4: If p{x), q( x) are polynomials with coefficients in 
a field § then there exists a polynomial d(x) such that 

(8.13) p(x) = 0 (d(x)), q{x) = 0 (d(x)) 

and such that p{x) = 0(h(x)), q(x) = 0(h(x)) implies d(x) = 
0 (h(x)). Further there exist polynomials a(x) and b(x) such that 

(8.14) a(x)p(x ) -f- b{x)q(x) = d(x). 

If d(x) has the first coefficient 1 then d{x) is called the greatest 
common divisor of p(x) and q(x) and we shall write 

(8.15) (p(x), q{x)) = d(x). 
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If d(x) fulfills the conditions of Theorem 8.4 then a-d( x) also 
fulfills these conditions for every non-zero mark a of g. Hence 
if b is the first coefficient of d(x) then b~'d(x) also fulfills the 
conditions of Theorem 8.4 and has first coefficient 1. It also 
follows that the greatest common divisor is uniquely deter- 
mined. 

Proof of Theorem 8.4: Consider all expressions of the form 

(8.16) a{x)p{x) + b(x)q(x ) = d(x) 

for all a{x) and b(x). Let d{x) in 8.16 have the lowest possible 
degree whereby the polynomial 0 is not considered to have a 
degree. We shall prove that d{x) satisfies the conditions of 
Theorem 8.4. By long division we can obtain a polynomial h(x ) 
such that 

(8.17) p(x) — h(x)d(x) = r(x) 

is either 0 or has a smaller degree than d{x). Multiplying 8.16 
by h{x) we have 

h(x)a{x)p{x) + h{x)b(x)q{x) — p{x) — r{x) 

Putting 

a(x) — — [h(x)a(x) — 1], b(x) = — [h(x)b(x)] 
we have 

d{x)p(x) + b(x)q(x) = r(x) . 

Since d(x) has the lowest degree of all polynomials 8.16 it 
follows that r(x) = 0. Thus p(x) = 0(d(x)). Similarly q(x) = 
0(d(x)). From 8.16 it is obvious that d(x) also fulfills all the 
other conditions of Theorem 8.4. 

Definition: If g(x) with coefficients in a field § has no divisor 
except a and a-g{x) with a C ?, then g(x) is called irreducible 
in g. 

We now define congruences modulo a polynomial m(x) in 
exactly the same way as congruences in the system of all in- 
tegers. We then calculate mod m(x) by adding, subtracting, 
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and multiplying in the ordinary manner and by always re- 
placing every polynomial /(x) by the residue of smallest degree 
obtained in dividing /(a:) by m(x). 

Theorem 8.5: If g(x) is irreducible in g then the residues mod 
g(x) in the system g(x) of all -polynomials with coefficients in g 
form a field. 

That the field postulates are satisfied by the system of 
residues mod g(x) is obvious except for the existence of an 
inverse. Hence Theorem 8.5 is proved if we can prove: To 
every /(x) 0(g(x)) there exists a q(x) such that f(x)q{x) = 

l(gr(x)). This is equivalent to stating that there exists a X(x) 
such that 

(8.18) f(x)q(x) - 1 = Hx)g(x). 

Since g(x) is irreducible and /(x) ^ 0{g{x)) we have (/ (x ) , 
g(x)) = 1 and Theorem 8.5 follows from 8.16. 

We now take g to be the finite field, G.F.(p) of residues 
mod p, then we have 

Corollary to Theorem 8.5: If g(x) of degree n with coefficients 
in G.F.(p) is irreducible in G.F.(p) then the residues mod g(x) 
form a Galois field with p n elements. 

Every polynomial with coefficients in G.F.(p) is, mod g{x), 
congruent to one of the p n polynomials 

(8.19) a 0 + a ix + • • • + a,.,/" 1 , 

where a 0 , a x , • • • , a„_, may be any of the residues mod p. 

Hence to construct a G.F. ( p n ) we have to find an irreducible 
polynomial of degree n with coefficients in G.F. (p) . 

For instance the polynomial x 2 + x + 1 is irreducible mod 2. 
Hence the residue 0, 1, x, x + 1 form a G.F.(2 2 ). Also 

x° = l(x 2 + X + 1), 

xf - x(x 2 + X + 1), 

X 2 = X + l(x 2 + X + 1). 
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Hence a; is a primitive root of this Galois field. Writing the 
addition and multiplication tables for the marks 0, 1, x, x + 1 
we have 


Addition 



0 

1 

X 

X + 1 

0 

0 

1 

X 

X + 1 

1 

1 

0 x 

+ 1 

X 

x 

X 

x + 1 

0 

1 

x + 1 

X + 1 

X 

1 

0 


Multiplication 
0 1 

X 

X + 1 

0 

0 

0 

0 

0 

1 

0 

1 

X 

X + 1 

x 

0 

X X 

+ 1 

1 

X + 1 

0 

X + 1 

1 

X 


From the addition table we obtain, since x is a primitive 
root, 3 orthogonal Latin squares of side 4 by cyclically per- 
muting the last 3 rows. We shall however replace x by 2 and 
x -f- 1 by 3. This yields the following 3 orthogonal Latin 
squares. 


0 12 3 

0 12 3 

0 12 3 

10 3 2 

2 3 0 1 

3 2 10 

2 3 0 1 

3 2 10 

10 3 2 

3 2 0 1 

10 3 2 

2 3 0 1 
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The polynomial x 2 + x — 1 is irreducible mod 3 since 
0 2 + 0 — 1 = -1(3), l 2 + 1 - 1 - 1(3), 
(-1) 2 + (-1) - 1 - ( 1) (3) . 

The mark a; is a primitive root for 

x° =1, x 4 = -1, 


x = x, 
2 


X = —x 
6 


x 2 = — X + 1, X = x — 1, 

x 3 = — x — 1, X 7 = X + 1. 

We leave it to the reader to obtain, using this Galois field, 
8 orthogonal Latin squares of side 9. 

Theorem 8.6: There is a Galois field of order p r to every prime 
p and every r. 

The proof requires several steps. 

Lemma 8.2: Every modulo p irreducible polynomial of degree 
r is, mod p, a divisor of x*'* 1 — 1. 

We shall write a(x) = b(x) mod (/(x), p) (in words a(x) 
congruent 6(x) modulis /(x) and p) if a(x) — b(x) is divisible 
by f{x) mod p. The residues mod (/ (x) , p) form a Galois field 
of order p T . Hence 


(8.20) 


x v ’ 1 = l(/(z), p), 


x"' 1 - 1 = 0(/(x), p) 


and this is Lemma 8.2. 

Lemma 8.3: If /(x) is irreducible mod p and of degree s > r 
then/(x) is mod p not a divisor of x pr_1 — 1. 

Assume that x”' -1 - 1 = 0(/(x), p) and consider the Galois 
field of residues mod (/(x), p). The order of this Galois field is 
p‘. Every element of this Galois field is of the form a 0 + a,x + 
• • • + a k x k , k < s where a 0 , a, , • • • , a k are residues mod p. 
Now 
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(8.21) (a 0 + a x x + • • • + a k xY 


= a 0 + <hx + • ■ • + a k x k (f(x), p) 

since x*’ = x(J(x), p) by assumption. Hence p r - 1 is an upper 
bound for 4he order in our Galois field, but this contradicts 
Theorem 8.3 since s > r. 


Lemma 8.4: The polynomial x m — 1 has no double roots mod 
p if m fzi 0 (p). 


We can define the differential quotient for polynomials mod 
P by the same formal rules as in ordinary calculus. It is easy 
to prove then that a polynomial has, mod p, a double root 
only if f(x) and df /dx have a common factor. But obviously 
x — 1 and mx m 1 have, mod p, no factor in common if m is 
prime to p. 

We can now prove Theorem 8.6: The polynomial x v '~ l — 1 
has, mod p, no irreducible factor of degree larger than r. All 
the irreducible polynomials of degree f < r are, mod p, factors 
of £ — 1. Since x” 1 — 1 has no double roots, the sum of 

the degrees of all irreducible factors of degree / together is thus 
at most p f — 1. Hence the sum of the degrees of all factors of 
degree <r is at most 


Hv f < 


f-l 



Hence there must be at least one irreducible factor of degree r. 
Let fix) be this polynomial. Then the expressions 


(8-22) a 0 + a k x - \- + a r . k x r 1 


mod (p, f{x)) form a Galois field of order p r . 

Definition: Two fields and are called isomorphic if there 
exists a bi-unique correspondence a <-» a', a C 5, a' C g' such 
that a *-* a', b <-> b' implies a + b <-> o' + b' , ab <-» a'b'. 

Theorem 8.7: Any two Galois fields with p r marks are iso- 
morphic. 
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It is easy to see that every G.F.(p) is isomorphic with the 
system of residues mod p. We know that there exists a mod p 
irreducible polynomial g(x) of degree r. Let g be any Galois field 
with p r marks a 0 — 0, = 1, a 2 , • • • , av-i . Then x v — 

1 = (x — cti) ••• (x — a v Since g(x) mod p is a divisor 
of x”'-' — 1 it follows that for some i we must have g(af) = 0. 
Since g is irreducible mod p, the expressions 

(8.23) a 0 + ala,- + • • • + u r -i«< 

where the a< are multiples of the unit element of g must all 
be different from 0 and thus also different from each other. 
Otherwise g(x) mod p would have a factor in common with a 
polynomial of degree <r. Thus 8.23 presents p r different ele- 
ments of § and hence every element of g. But the corre- 
spondence /(a,) <-> fix) where /(a<) C g and /(x) is in the 
field g of residues mod (g(x), p) is clearly an isomorphism. 
Thus any two fields g, g' are isomorphic to g and hence 
isomorphic to each other. 

In an abstract sense we have therefore only one Galois field 
with p r marks. We shall denote this Galois field by G.F.(p r ). 

If x in the field of residues mod (/(x), p) does not satisfy 
any equation x m — 1 = 0(/(x), p) with m < p r l , then x is a 
primitive root. On the other hand if a is a primitive root of 
G.F.(p r ) then a must satisfy an irreducible equation of degree 
r. Thus if we wish for convenience to have G.F ,{p r ) presented 
by the residues mod p) in such a way that x is a primitive 
root, then we have to remove from x v ’~ l — 1 all factors which 
are factors of x m - 1 for any m < p r - 1. The remaining 
polynomial has as its roots all the primitive roots of G.F.(p r ) 
and must therefore have by Theorem 8.3 the degree <t>(p r — 1). 
We shall call it the cyclotomic polynomial of order p r — 1. 

To construct, for instance, G.F.(2 3 ) we first form the cyclo- 
tomic polynomial of order 2 3 — 1 = 7. Its degree is <t>(7) = 6. 
Removing the root 1 from x 7 — 1 we obtain 


x 6 + x 6 + x 4 + x 3 + x 2 + x + 1. 
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This polynomial must mod 2 decompose into 2 factors of 
degree 3 each. Thus 

(x 6 + X 5 + X* + X 3 + X 2 + X + 1) 

= (x 3 + ax 2 + 6x + c)(x 3 + ax 2 + 6x + c)(2) 

Hence 

cc = 1(2), c = c= 1(2), b + 6 = 1(2). Let b = 0, 6 = 1(2). 
Then 

ac + ac+66 = a + a = 1(2) c+c + a6 + 6a = a = 1(2). 
Hence a = 1(2), a = 0(2) and 
x 6 + x 5 + x 4 + x 3 + x 2 + x + 1 

= (x 3 + x 2 + l)(x 3 + x + 1)(2). 

It is left to the reader to construct G.F.(2 3 ) and 7 orthogonal 
Latin squares of side 8. 

For higher values of p r — 1 it is rather laborious to find mod 
p irreducible polynomials of degree r by decomposing the 
cyclotomic polynomial of order p r — 1. It is however easy to 
find irreducible polynomials in other ways, if we are willing 
to forego the advantage of having x as a primitive root. For 
instance, if p is odd then there always exist residues a for 
which x 2 = a(p) is not solvable. Then x 2 — a is irreducible 
mod p. The polynomial x 3 — x is identically 0 mod 3; thus 
x 3 — x — 1 is irreducible mod 3 since it otherwise would have 
a linear factor mod 3. The polynomial x 4 + x + 1 is irreducible 
mod 2. Obviously it does not have the root 0 or 1, thus the 
only possible decomposition would be of the form 

x 4 + x + 1 = (x 2 + bx + l)(x 2 + b'x + 1)(2). 

From which it would follow that 6 + 6' = 1(2) and 6 + 6' == 
0(2) which is impossible. With these and similar considerations 
one easily obtains the following irreducible polynomials: 


103 


mod 2 x 2 + x + 1, x 3 + x + 1, x* + x + 1, x 5 + x 2 + 1, 

mod 3 x 2 + x — 1, x 3 — x + 1, 

mod 5 x + 2, 

mod 7 x + 1. 

These polynomials take care of all Galois fields with less than 
63 elements and these satisfy all needs that have arisen so far 
in the design of experiments. 

From Theorem 8.6 and Theorem 8.1 we see that a set of 
m — 1 orthogonal Latin squares of side m can always be con- 
structed, if m is the power of a prime. If m is not the power 
of a prime then m may be decomposed into prime powers. 

m = pi' ■■■ p’.‘ ( Pi ^ Pi). 

We then construct the following system. We consider “points”. 

y = (g n) ,g w , ■■■,g M ), g w CG.F.(pn. 

We define addition and multiplication by the rules 

+ /_< 1 > _(*)\ + ( 

7i x T 2 — (<7i > ' • ' > 9i ) x \9 2 j > 02 ) 

— (?i x 02 > ' • ' > ffi x g-i )• 

The system thus constructed is not a field since, for instance, 
the element (0, 1, • • • , 1) has no inverse in multiplication. 
However, the postulates I-IV for addition and I-III for multi- 
plication and postulate V are fulfilled. All the “points” which 
have no 0 among their coordinates possess inverses. 

Let 

o, = i, fl4°, ••• , g$<-i 

be the marks of G.F.(p”‘), then if r = min,(p'‘ — 1) the 
“points” 


(8.24) 


7 i = (gr,gr,---,gn, 0 <j<r 
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possess inverses and also y,- — 7 , does if i j. Now we number 
the points 7 in such a way, that the first r elements are given 
by 8.24 and form the r arrays. 


?>• + 1 • • • 7; + 7m— 1 

(8.25) Lj = 7,-7 2 7,72 + 1 • • • y,y 2 + 7 m _! 


7 j7m— 1 7 J 7 m— 1 + 1 • • • 7,7m— 1 + 7m — 1 . 

We prove first that L, is a Latin square. Suppose the ath 
row would contain an element twice then 

7,7a + 7t = 7,7a + 7/ 

from which 7 * = 7i ,k = l follows. Suppose that the tth column 
contains the same element twice, then 

7< + 7, -7a = 7 + 7,-7/s j < r 

and since 7 ,- possesses an inverse this implies y a = yp . 

We shall now prove that L < is orthogonal to L, if i ^ j. 
Assume that they were not orthogonal. Then in superimposing 
Lt on Lj we should have two compartments in the resulting 
square containing the same pair of “points”. If this pair occurs 
in the ath row and the /3th column and in the cth row and the 
rth column, we should have 

7,7a + 7/9 = 7,7* + 7r , 

7<7« + 70 = 7,'7« + 7 * • 

Hence 

(8-26) ( 7 ,- — 7 ,.) 7 „ = ( 7 ; — 7 ,) 7 „ 

and since 7 ,- — 7 ,- possesses an inverse 8.26 implies y a = y, 
and consequently y fi — y T . Thus we have 
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Theorem 8.8: Let g\, , gYY , • • • , g<Y denote the elements of 
G.F.(pJ‘), • • • , G.F.(p“') respectively where gY’ is the 0 element 
and g\ x) the unit element of G.F.(p-‘). Form the points 


which are multiplied and added by multiplying and adding their 
coordinates. Let further 

7, = 0 < j < r = min (pY - 1) 

« 


and number the remaining points in any arbitrary way from 
r + 1 to m = pY • • • p e ,' in such a way that y m = 0 = (go U , 
• • • , S , o* > )‘ Then the arrays 

0 1 • • • Tm-l 

7; 7i + 1 • • • 7/ 7«-i 


Li = 7,72 7,72 + 1 


7,72 + 7m-i O’ = 1, ■ ■ • > T) 


7;7m-i 7,7m-i + 1 ' ’ • 7;7m-i + 7m-l 

/orm a set of r orthogonal Latin squares. 

This result is the best that has been obtained so far. No case 
of more than r = min,- (pY — 1) orthogonal squares is known 
to date. Tarry (Le Probleme de 36 Officiers. Comptes Rendus 
de’l Association Francaise pour L’avancement des Sciences II 
(1901) pp. 170-203) found by a skillful tactical enumeration 
that no 6 sided orthogonal pair exists. For numbers larger than 
6 which are not powers of a prime the problem is completely 
unsolved 1 although it has been considered by mathematicians 

‘After completion of this manuscript R. H. Brack and H. J. Ryser 
(Canad. J. of Math. Vol. 1, pp. 88-93) proved the non-existence of m — 1 
orthogonal squares of side m if m = 1, 2 (4) and the square free part of m 
is divisible by a prime of the form 4 k + 3. 
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long before Latin squares were applied in designing experi- 
ments. 

It can readily be shown that no more than to — 1 orthogonal 
Latin squares of side to can be constructed. For we may always 
arrange the numbering in the Latin squares in such a way that 
the first row is 1, 2, • ■ • , to. Then in the remaining com- 
partments different Latin squares must contain different num- 
bers which must also be different from the column number. 
Thus at most (to — 1) Latin squares of side to can occur in a 
set of orthogonal Latin squares. 

Historically it may be remarked that the first proof of the 
existence of (to — 1) orthogonal Latin squares if to is a prime 
power seerqs to have been given by McNeish. (Annals of 
Mathematics, Vol. XIII, pp. 221-227.) The methods for the 
construction of orthogonal Latin squares presented in this book 
were found independently by W. L. Stevens (Nature, Sept. 
3, 1938) and by R. C. Bose (Sankhya, Nov., 1938). 


CHAPTER IX 


The Construction of Incomplete 
Balanced Block Designs 

In the construction of incomplete balanced block designs 
finite projective geometries have been utilized and yield whole 
series of these designs. For our purposes it will be sufficient to 
consider finite analytic geometries. The points of these geome- 
tries are defined as follows. We consider G.F.(p"). A point in 
the m dimensional finite geometry P.G.(m, p") is an ordered 
set of m -f 1 elements of G.F.(p"), not all of which are equal 
to 0. Two sets g m+ ,), (gi , ■■■ , g'm+i) represent the 

same point if g< = X^< , t = 1, • • • , m + 1, 0 X C G.F.(p n ). 
For any two distinct points pi = (gi , • • • , g m+ i), p 2 = 
(g[ , • • • , g' m+1 ) we define as the line joining them the set of all 
points of the form 


(9.1) 


XjPi -b X 2 P 2 — (Xi0! “b X2^2 j * ' ■ y Xi<7 m +i “b ^ 2 g m+\) y 


X, , X 2 c G.F.(p n ), 


where at least one of the X’s is different from 0. 

The system of points and lines obtained in this manner is 
called the analytic projective geometry of G.F.(p n ) of m di- 
mensions and is denoted by P.G.(m, p”). 

We first compute the number of points in P.G.(m, p n ). There 
are p” <m+1) ordered sets of m + 1 marks of G.F.(p n ). Since we 
excluded the set (0 • • • 0) there remain p" (m+1) — 1 ordered 
sets at least one of whose elements is different from 0. These 
may be arranged in groups of p n — 1 sets all of whose elements 
represent the same points, since (g x , • • • , g m +i) = (X? 1 , • • • » 
\g m+1 ) for every X ^ 0 in G.F.(p"). Hence there are 

n(m + 1) -I 

(9.2) ? 1 + P- + •■■+»»" 
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distinct points. The lines are given in the form X,p, + X 2 p 2 
where p, and p 2 are distinct points. The points of this line are 
given by their line coordinates X, , X 2 . Two points X x , X 2 ; 
M: , V -2 will be distinct if (X a , X 2 ) ^ v{ii x , M2 ) for all v in G.F.(p"). 
Hence the points of a line form an analytic one dimensional 
geometry and the line has therefore 1 + p n points. 

We now consider the fc dimensional subspaces of P.G.(m, p"). 
Let pi , • ■ • , Pk+i be fc + 1 linearly independent points. That 
is to say 

(9.3) XjPj + • • • + X* +1 p* +1 = (0, • • • , 0) 

implies X! = • • • = X* +I = 0. We consider then all the points 
of the form Xjp, + • • • + X k+1 p k+l . Assume that two of these 
points are equal. Then 

XiPi + • • • + X* +1 p i+1 = r(/JiPi + • • • + Mk+iPk+i), 

(X! — j-mOpi + • • • + (X* +1 — vp k+1 )p k+1 = (0, • • • , 0). 
Since p k , ■ , p k+1 are independent this implies 

^1 = VUl , ‘ ■ • , X* + i = Vfl k + i . 

We can now introduce coordinates Xj , • • • , X t+1 in the fc 
dimensional subspaces. Clearly for fc > 1 the subspaces con- 
tain for every two points also the line joining them. Hence 
every fc dimensional subspace of a P.G.(m, p n ) is itself a P.G. 
(fc, p n ) and has therefore 1 + p" + • • • + p hn points. We now 
compute the number of P.G.(fc, p n ) contained in a P.G.(m, p"). 
Every P.G.(fc, p n ) is determined by a set of (fc + 1) inde- 
pendent points. The first of these, p k , may be chosen in 1 + 
p" + • • • + p n ” ways. For p 2 we have then p n + • ■ • + p” m 
choices. For the third p 3 we may choose any point not on the 
line through p, and p 2 which leaves us p 2n + • • • p nm choices. 
After the Zth point (l < fc + 1) has been chosen, we may choose 
for the ( l + l)th point any point not in the P.G.(Z — 1, p n ) 
determined by p x , • • • , p t . Thus 1 + p n + • • • + p n(, “ I) 
points are excluded and p !n + • • • + p mn are left to choose 
from. Thus the number of distinct ordered sets of fc + 1 inde- 
pendent points in P.G.(m, p”) is 


(9.4) 


(!+•••+ p m ") • • • (p kn + • • • + v m "). 
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The number of ordered sets of (k + 1) independent points 
in P.G.(fc, p n ) ^ by 9.4 

(i + ■ • • + v n ) • • • (z>“' 1)B + v k lv K i 

Hence the number of P.G.(fc, p") contained in P.G.(m, p“) 
becomes 

rq -v (! + •••+ v mn )(v + ••• +D- <p n + • • • + p mn ) 

K 4 * (1 + • • • + v kn ) ■ ■ ■ (p " 1-1 ” 1 + pV" 

We finally want to find the number of P.G.(s, p") in P.G. 
(m, p") which contain a given P.G.(fc, p n ). We first choose a 
point p k+ 2 not contained in the given P.G.(fc, p"). This point 
p* +2 may be chosen out of p <i+1,n + • • • + p mn points. We then 
choose p t+3 out of the p (h+2)n +•••-(- p m " points not contained 
in the P.G.(/c + 1, p") which contains p t+2 and the given P.G. 
(fc, p”). Continuing in this manner we can obtain a P.G.(s, p”) 
containing the given P.G.(fc, p") in (p <<!+1) " + • • • + p mn ) • • • 
(p* n + • • • + p m " ) ways. Putting m = s we see that every 
P.G.(s, p") is obtained in this manner in (p ik+l)n + • • • + p‘ n ) 

■ ■ • (p <,-u " + p' n )p‘ n ways. Hence for s > k we must have 

(p (t+1,n + • • • + p mn ) • • • (p' n + • • • + p ron ) 

(p ( * +1,B + • • • + p* n ) • • • (p‘- 1,n + p'V 

different P.G.(s, p") in P.G.(m, p“) which contain a given P.G. 
(*, Pi- 

Summarizing we have: 

1. Every P.G.(m, p") contains exactly 1 + p" + • • • + p m " 
points. 

2. Every P.G.(m, p") contains exactly 

(1 + p" + • • • + p mn ) • • • (p tB + • • • + p m l 

(1+ p” + • • • + p kn ) • • • (p“- 1,n + p ’ 


P.G.C^p"). 
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3. Every P.G.(fc, p n ) in P.G.(w, p n ) is contained in 

(P (>+I>n + • • • + p mn ) • • • ( p ‘ n + ..,+p") 

(P lk+U% + • • • + P"‘) ■ ■ ■ + p’ n )p’" 

P.G.(s, p n )’ s for s > k. 
For k = 0, 1 one obtains in particular : 

A. Every point is contained in 

r _ (p n + • • • + p mn ) (p"+ ■■■ + pQ 

(p" + • • • + p‘ n ) ■ v (P u ' 1>n + p ,n )p ,n 
P.G.(s, p ") o/ a P.G.(m, p n ) m > s > 0. 

B. Every line is contained in 

X = (P 2n + • • • + P m ") •••(?!»+■■•+ p-) 

(p 2 ” + • • • + p«) • • • (p”) 

P.G.(s, p n ) /or m > s > 1. 

Every P.G.(s, p n ) contains with every pair of points also the 
whole line joining them. Thus every pair of points is contained 
in X different P.G.(s, p"). 

We may now identify the points with varieties and the P.G. 
(s, p ) with blocks. Then we have the following theorem. 

Theorem 9.1: The P.G.(s, p n ) contained in a P.G.(w, p") form 
a balanced incomplete block design with the parameters 

(9.6) h - (1 + P" + ' ' • + ^ ' fa'" + • • • + pQ 

(1 + • • • + p ,n ) ■ ■ ■ (p'- 1 ’" + p’^p’" 

= b(s, m, p n ), 

v = 1 + p* + • • • + p mn = v{m, p n ), 
k — 1 + p" + • • • + p’ n = k(s, p”), 


r 
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(p" + - ■ ■ + p mn ) • • • (P’ n + • • ■ + P m l 

(p n + ■■■ + p”) • • • (p ( - 1)B + P*> 

= r(s, to, p"), 

1 if s = 1 

(p 2 " + • • • + p m ") • • • (P ,n + • • • + P m l 

(p 2n + • • • + p“) • • • (p'" 1,n + P'")p' n 

. = X(s, m,p n ) if s > 1 . 

We next consider the points in P.G. (to, p") common to a 
given P.G. (to - 1, p”) and a given P.G.(s, p") not contained 
in it. Let p x be a point in the P.G.(s, p”) which is not contained 
in the P.G. (to - 1, p n ). Let q x , ■ • • , q m be m linearly inde- 
pendent points in the P.G.(m — 1, p”). Then pi , , • • • , q m 

are m + 1 linearly independent points and hence every point 
of P.G.(m, p") is of the form 

XiPi + ^2<7 i + ■ • • + X m+ ig m . 

Now let Pi , p 2 , • • • , p. +1 be s + 1 linearly independent 
points of the given P.G.(s, p”). Then for every i we must have 
an equation 

(9.7) p. = X{°p, + + • • • + X”*! g- • 

Therefore p[ = p, - X(°pi , t = 2, ■••,*+ 1, is contained 
in the P.G.(m - 1, p"). The points p( , • ■ • , p.'+i are obviously 
linearly independent. Hence the P.G.(s - 1, p n ) of points of 
the form X 2 p( + • • • + X. +1 p.' +a is contained in the P.G. 
(m - 1, p”). But these are all the points of the given P.G. 
(s, p") which are contained in the P.G.(m — 1, p"). If there 
were another point pi of the P.G.(s, p") contained in the 
P.G.(m — 1, p") and linearly independent of pi , • • • , pl+i , 
then Xjpl + • • • + X. +1 p.' +1 would present every element in 
the P.G.(s, p"), contrary to the hypothesis that not all its 
points are contained in the P.G. (to — 1, p n ). 
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Now by deleting from a P.G. (to, p n ) any given P.G. 
(m — 1, p n ) and all its points one obtains another system of 
points and lines which is termed the finite analytic Euclidean 
Geometry E.G. (to, p") of to dimensions. Every P.G.(s, p n ) con- 
tained in P.G. (to, p ) but not in the P.G. (to — 1, p n ) becomes an 
E.G.(s, p"), since by deleting a P.G.(to - 1, p n ) from P.G.(to, p") 
we also delete a P.G.(s - 1, p n ) from each of these P.G.(s, p") 
contained in P.G. (to, p"). The number of points of an E.G. 
(to, p") is 

v(m, p n ) - v(m - 1, p") = p mn . 

The number of E.G.(s, p n ) contained in E.G. (to, p n ) is 
b(s, to, p n ) — b(s, to — 1, p n ). 

The number of E.G.(s, p n ) containing a given E.G.(fc, p B ) is 
the same as the number of P.G.(s, p") containing a given 
P.G.(fc, p"). Hence we have 

Theorem 9.2: The E.G.(s, p”) contained in an E.G.(to, p”) 
form a balanced incomplete block design with the parameters 

b = b(s, to, p") - b(s, to - 1, p n ), 

v = p mn , 

(9.8) k = p”*, 

r = r(s, to, p"), 

X — X(s, to, p n ). 

As an example we construct the lines of the P.G. (3, 2) and 
the E.G. (3, 2). Applying 9.6 and 9.8 we see that we have in 
the P.G. (3, 2) exactly 35 lines and 15 points and in the E.G. 
(3, 2) exactly 28 lines and 8 points. Every point must occur 
in 7 lines. Every line of the P.G. (3, 2) contains 3 points and 
every line of the E.G. (3, 2) contains 2 points. Hence the bal- 
anced block designs which we shall obtain have the parameters 

b = 35, v = 15, r = 7, k = 3, 

6 = 28, v = 8, r = 7, k = 2, 


X = 1; 
X = 1. 
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The second design consists simply of all pairs of points and can 
easily be obtained directly. G.F.(2) consists of the two elements 

0, 1 with the rules of composition 0 + 0 = 0, 0+l=l+0= 

1 , 1 + 1 = 0 . 

The points are then given by 

p x = 1000, p 5 = 1100, p 9 = 0101, p 13 = 1011, 

p 2 = 0100, p 6 = 1010, p 10 = 0011, p l4 = 0111, 

p 3 = 0010, p 7 = 1001, pn = 1110, p 15 = 1111. 


p 4 = 0001, p 8 = 0110, p 12 = 1101, 

The lines can be obtained by taking pairs of points, for 
instance, p, and p 2 and forming X^ + X 2 p 2 for (X, , X 2 ) = 
(0, 1), (1, 0), (1, 1). Thus for instance the points in the line 
Pi , p 2 are pi , p 2 and Pi + p 2 = Ps • The lines through p, , p 5 
and p 2 , ps need not be constructed if the line through p l , p 2 
has already been written down. Proceeding systematically in 
this way one obtains 35 lines. 


P 1 P 2 P 5 , 

P 2 P 3 P8 ) 

P 3 P 5 Pn , 

P4PllPl5 , 

Po P 12 P 14 

P 1 P 3 Pe > 

P 2 P 4 P 9 , 

PsP? P 13 , 

PsPe ?8 ; 

P7 P8 Pl5 

ViP^Vt , 

P 2 P 6 Pn , 

P 3 P 9 Pn , 

PaPrPa , 

p 7 P 11 P 14 

PiPs Pn » 

P 2 P 7 P 12 , 

P 3 P 12 P 15 , 

P 5 P 10 P 15 , 

P8 P 9 PlO 

P 1 P 9 P 12 , 

P 2 P 10 P 14 , 

P 4 P 5 P 12 , 

P 5 P 13 P 14 j 

P8 Pl2Pl3 

P 1 P 10 P 13 1 

P 2 P 13 P 15 , 

p 4 p« P 13 ; 

PeP7 PlO , 

P 9 PllPl3 

P 1 P 14 P 15 > 

p 3 p 4 P 10 , 

P 4 P 8 Pl4 , 

PeP9 Pl5 ; 

Pl0PllPl2 


If we delete from this design all the points with last coordinate 
0, that is to say, the plane \ x pi + X 2 p 2 + X 3 p 3 then we must 
obtain the E.G.(3, 2). The deleted points are Pi , p 2 , Pa , Ps > 
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Pa > Pb , Pn ■ The reader may verify that the remaining sets 
consist of all possible pairs of the remaining 28 points. To give 
also a non-trivial example of a finite Euclidean geometry we 
shall construct the E.G.( 2 , 3 ). The P.G.( 2 , 3 ) has 3 2 + 3 + 
1 = 13 points; the E.G.( 2 , 3 ) has 9 points. G:F.( 3 ) consists of 
the marks 0 , 1 , —1 considered mod 3 . The points of P.G.( 2 , 3 ) 
are: 


Pi = 1 , 0 , 0 , p 5 

= 1 , 0 , 1 , Pa = 

1,0,— 1, 

t-H 

T— ( 

1 

o' 

II 

a 

p 2 = 0 , 1 , 0 , p 6 

= 0 , 1 , 1 , p I0 = 

- 1 , 1 , 1 , 


p 3 = 0 , 0 , 1 , p 7 

= 1 , 1 , 1 , Pn = 

1 , — 1 , 1 , 


P 4 = 1 , 1 , 0 , p 8 

= 1, — 1 , 0 , p 12 = 

1 , 1 , — 1 , 


The line through p, and p 2 consists of the points p, , p 2 , 
Pi + p 2 = Pi , Pi — p 2 = p 8 . Systematically proceeding as 
before one obtains the fines: 

P1P2 P* Pa , 

P2PaPa P13 , 

PaPaPioPn , 

PiPaPaPn , 

PiPsPaPa , 

PiP&Pi P11 , 

P4P5P10P13 , 


PiPa Pi P10 , 

P2P0P10P12 , 

PtPaPa Pn , 


P1P11P12P13 , 

PaPiPi P12 , 

PsPsPs Pi 2 , 


Now we delete one line, say the first and all the points on it 
and obtain 

Pa Pa Pa 

, PaPa P12 , 

P3P7 P12 , 

PaPaPn , 

Pa Pi P10 

, PaPi Pn , 

P3P10P11 , 

PaPaPi2 , 

P11P12P13 

, PaP\oP\2 ) 

P5P10P13 , 

P7P9P13 • 

This is the E.G.( 2 , 3 ). 




The E.G.( 2 , p") can also easily be obtained from a set of 
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p n — l orthogonal Latin squares of side p n which were con- 
structed from a Galois field. We take as points the compart- 
ments of the Latin square numbered from 1 to p 2n . The lines 
are then given by the columns, the rows, and by the sets of 
compartments whose ith number is a, (a = 1, • • ■ , p"), 
(i — 1, • • • , p n — 1). These lines are arranged in m + 1 sets 
of m parallel lines each. Thus for instance the rows are parallel 
to each other. To obtain the P.G.(2, p n ) one adds additional 
points, the same point to each line of a set of parallel lines and 
different points to intersecting lines, and takes these additional 
points into one additional line. 

Finite geometries furnish whole series of balanced incomplete 
block designs. However, only a few of these are at present of 
practical interest since the number of replications should in 
most practical cases not exceed 10. 

Other series of these designs can be obtained by applying 
two theorems/ first proved by R. C. Bose. (Annals of Eugenics, 
9 (1939) pp. 358-399.) To formulate these two theorems we 
need the concept of a module. A module is a system of elements 
such that to each pair of elements a, b there is uniquely defined 
a sum a + b satisfying the postulates I, II, III, IV for the 
addition in a field. For instance the residues mod m form a 
module for every m. A module with a finite number of elements 
is called a finite module. If 2ft has n elements then 2ft is called 
a module of order n. 

Let 2ft now be a module of order n and let m varieties Aj'\ 
••• , Ai*' correspond to every element A <0 of the module. 
We may form blocks of these varieties. 


(9.9) (Air 1 


a<:°), (A<?‘> 


AD- 


From every block of k varieties we may write fc(fc — 1) 
expressions of the form A r — B s = (A — B) yS . This ex- 
pression is called a difference of type yd. 

Taking for instance as our module the residues mod 5 we 
could form the blocks 


(0, , 1 2 , 2,), (0 2 , 3 t , 4 a ). 
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Then the differences are 1 21 , 2„ , 4 ia , 1 I2 , 3„ , 4 21 from the 
first block, 3 J2 , 4 22 , 2 21 , 1 21 , 1 22 , 4 12 from the second block. 
The differences of type a/3 are called pure if a = /3 and mixed 
if a ?*= |8. 

If in t blocks every pure difference except 0 is repeated X 
times and every mixed difference the same number X of times, 
then the differences are termed symmetrically repeated. 

We shall now prove the following theorem. 

Theorem 9.3: Let 21? be a module containing the elements 
v (0 \ • • • , i/"" 1 ’ and let m varieties vj <> , • • > , correspond to 
every element v M . The variety v] a) is said to belong to the j'th 
class. Suppose that there exist t blocks of elements 73, , • • • , B, 
such that 

1. The varieties in each block are different from each other. 

2. Among the elements in B, , B 2 , • • • , B, exactly r varieties 
belong to each of the m classes. 

3. The differences arising from B l , • • ■ , B, are symmetrically 
repeated, each occurring X times. 

If 

b = (»!?’, • • • , O 

and v" + 6 = v" let 

(9-10) B e = (»»*>, ••• 

Form the blocks B ie for all i and all 9 C SOi, then: 

1. In the blocks B, e every variety occurs r times. 

2. Any two varieties occur together in the same block exactly X 
times. 

Corollary: If each block B, contains the same number of varieties 
the blocks B jS form an incomplete balanced block design. 

Proof of Theorem 9.3: To every pair of elements v, v' of 2ft 
there is exactly one 0 such that v + 6 = v'. Hence since r of 
the varieties in B, , • • • , B t belong to the 7th class, the variety 
v'i will occur exactly r times. In order that a pair u a , v e of 


117 


varieties occurs exactly fi times in the blocks it is necessary 
and sufficient that exactly n times for u' a and Vp in the same 
block 

u' + 0 — u, 

(9.11) 

v' + 6 — v. 

Hence u' — v' = u — v = d. Then 6 = u — v! — v — v'. 
Hence the pair u a , vp occurs exactly as many times as the 
difference d arises as a difference of type ad in the initial blocks 
B t , - • • , B , , that is to say n = X times. This proves the theorem. 

As an example consider the group of residues mod 2t + 1 
and the pairs 

(1, 2 <), (2, 2< - 1), • • • , (t, t + 1). 

Every residue different from 0 arises from these pairs just 
once. Now consider the blocks 

(1, , (20, , 0 2 ), (2j , (2 1 - 1), , 0 2 ), •••,«,,«+ l)i , 0 2 ); 

(1 2 , ( 2 O 2 , 0 3 ), (2 2 , (2 1 1) 2 , 0 3 ), • • • , (0 1 {t + 1)2 > 0 3 ); 

(I 3 , ( 2 O 3 1 0i)> (^3 > (2 1 1)3 , Oi) , • • • , (0 , (^ “h 1)3 t 00; 

(0, , 0 2 , O 3 ). 

All pure differences arise exactly once from the first two 
elements of the first 3 1 blocks. All non 0 mixed differences of 
type 1,2 and type 2,1 arise from the first set of blocks, those of 
type 2,3 and type 3,2 from the second set and those of type 
1,3 and 3,1 from the 3rd set. The mixed differences 0 arise 
from (0, , 0 2 , 0 3 ). Since each block contains 3 varieties, we 
obtain by applying Theorem 9.3 an incomplete balanced block 
design with v = 6i + 3, b = (3f + 1) (2f + 1), r = 3< + 1, 
k = 3, X = 1. 

For instance let t = 2, then 2t + 1 = 5 and the initial blocks 
are (1, , 4, , 0 2 ), (2j , 3, , 0 2 ), (1 2 , 4 2 , 0 3 ), (2 2 , 3 2 , 0 3 ), 
(1 3 , 4 3 , Oi), (2 3 , 3 3 , 0,), (0, , 0 2 , 0 3 ). We leave the construction 
of this design to the reader. 
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Let us now adjoin to the module 9ft the symbol oo with the 
rule of operation °° + a = ®. We shall now prove the following 
theorem. 

Theorem 9.4: Let 9 8 be a module with n elements u[ 0) , • • • , 
u in 1) . To every element u (a) let there correspond m varieties 
u[ a) , • • • , u„ ' , whilst one variety corresponds to the symbol oo. 
The variety u\ a) is said to belong to the ith class and the varieties 
u\ a) are called finite varieties. Suppose there exist t + s blocks 
B , , ■ • ■ , B, , B{ , • ■ • , B', , such that: 

1. The varieties in each block are different from each other. 

2. The blocks B x , • • • , B, contain exactly k finite varieties 
each while B[ , • • • , B', contain exactly ( k — 1) finite varieties 
and a>. 

3. Among the varieties in B x , • • ■ , B, exactly ns — X belong 
to each class, while among the varieties in B[ , • ■ ■ , B' exactly 
X belong to each class. 

4. The differences arising from the finite varieties are sym- 
metrically repeated, each occurring X times. 

We define the blocks B, e , B' ie as in Theorem 9.3. 

Then the blocks B, e , B' ie form an incomplete balanced block 
design with the parameters v = mn + 1 ,b = n(t + s), r — ns, k, X. 

From Theorem 9.3 it follows that every finite variety is re- 
peated r = ns times and each pair of finite varieties occurs X 
times. The variety oo occurs in each of the ns blocks B' it hence 
co occurs also ns times. Also each finite variety occurs in the 
B'it because of 3 exactly X times. Hence oo occurs with every 
finite variety X times together in the same block. 

As an application we shall construct designs with v = 12t + 4, 
b = (3< + 1)(4< + 1), r = 4< + 1, k = 4, X = 1 where 4< + 1 
is a power of a prime. 

We take the elements of G.F.(4< + 1) with respect to addi- 
tion as composition as our module 9ft. Let a; be a primitive 
root. We shall first show that there exist odd numbers a and 
q such that (x“ + 1)/ ( x a — 1) = x Q . 

The non 0 elements of G.F.(4< + 1) are given by x°, x 1 , • • • , 
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x 4<_1 . We form for every a ^ 0 (x“ + l)/(x“ — 1). This is a 
non 0 mark of G.F.(4f + 1) if a ^ 2 1, since a: is a primitive 
root x 2 ‘ t* 1 and hence x 2 ‘ = —1. Hence for all values a 0, 
2 1 we have 

+ 1 

(9.12) = x\ 


Clearly x“ = (x Q + l)/(x° — 1). Hence to every « ^ 0, 2< 
belongs a unique value q ^ 0, 2t but among the residues mod 
4< 1, 2, ■ • • , 2t — 1, 2t + 1, • • • , At — 1 there are 2 1 odd residues 
but only 2t — 2 even residues. Hence to at least 2 odd residues 
there must belong an odd residue. 

Now let 3 varieties correspond to each mark of G.F.(4f + 1). 
We form the (3 1 + 1) blocks 


r 2‘+2i T «+« 2‘+2* + «\ 

) X2 J X2 J 

( t 2{ r 2<+2< r 2< + “ r 2<+2i + a \ 

\X2 y X2 y Xs j X 3 J 

(JM ~ 2t+2i ~ 2 »'+« 2l + 2* + ax 

\X3 y X 3 y X\ y X\ J 


i = 0, 1, • • • , t — 1 


(00 , 0i ,02, O3). 

We observe first that x 2 ‘ = —1. We further put x“ + 1 = x“, 
x a — 1 = x”, x 2 ‘ — 1 = x p . Then we may choose a so that 


(9.13) 


u — v = 1(2). 


Every class of varieties occurs 4 1 times in the first 3 1 blocks 
and once in the last block. The differences of type (1,1) arise 
from the first and 3rd set of blocks and may be written as 


(9.14) x 2 


•’°(x 2 ' - 1) = x 2i+J< «‘ + «*“ + », (i = 0, •••,<- 1), 


where e! , t 3 are either 1 or 0. These are 4f differences. We shall 
show that no two of them are equal. Suppose that 


2» + t,2t + c a o+/3 2i + 6 , i2f + « , a«+/3 

X X • 


(9.15) 
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Then 


,2(«-0+2!(<i-c'i) + a(<a-c's) 


= 1. 


x 


Hence 


(9.16) 2 (t - j) + 2<(ei - ei) * -o(e, - *0(40. 


Since a is odd it follows that e 2 = c((2) and therefore t 2 = «2 • 
Thus i — j ss t(ei — e[)(2t). Hence either i — j = 0(2f) or 
i — j = t(2t). Both of these congruences are impossible for 
i 9^ j since i, j < t — 1. Hence the 4 1 differences of type 1, 1 
are distinct and different from 0 and therefore must contain 
each of the 4f non 0 marks exactly once. Similarly, it may be 
shown that every mark of G.F.(4< + 1) occurs exactly once 
among the differences of type 2, 2 and 3, 3. Let us now consider 
the mixed differences of type 1, 2. These arise from the first 
set of blocks and from the last block only. Those from the 
first set of blocks may be written as 


(9.17) 


x 2 i + <,2 ‘ - x 2i + “ + «‘ 21 


= x 2, (±l 



Hence one obtains one of the four expressions 

-x 2 V - 1) = x 2i+2 ‘ + ’, x 2, (x“ - 1) = x 2i+ \ 

x 2i (x° + 1) = x 2<+ “, -x 2i (x“ + 1) = x 2,+2,+u , 

hence either 


We obtain thus 4< non zero marks of G.F.(4< + 1). We shall 
prove that they are all different. We first observe that 


(9.18) 


x 


2t + e2<+u 


2 j + « ' 2 < + u 

X 


implies i — j = <(«' — e)(2<), which was already shown to be 
impossible. But 


x 


= x 


(9.19) 


2* + «2<+u 


,2 j + c ' 2 1 + v 
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implies u — v = 0(2) which contradicts 9.13. Thus each of the 
4< non 0 marks of G.F.(42 + 1) occurs excatly once among the 
differences of type 1, 2. The proof for the other mixed differences 
is analogous. The 0 differences of mixed type all arise from the 
last block. Thus all the conditions of Theorem 9.4 are satisfied. 

As an example let 42 + 1 = 9. G.F.(9) may be presented 
as the field of residues mod 3, y 2 + 1. G.F.(9) then consists of 
the 9 marks; 0, 1, -1, y, y + 1, y - 1, -y, -y + 1, -y - 1. 
x = ( — y + 1) is a primitive root. 

x 2 = (—2/ + l) 2 = V 1 + y + 1 = y, 

x 3 = {-y + 1 ) 3 = y -f'l, x 4 = -1, 

(9.20) 

x 5 = y - 1, x" = -y, x 7 = -1 - y, x* = 1. 

x + 1 _ —y — 1 x_ _ 

x — 1 — y ~ x ~ 

Hence we may take a = 1. The first set of initial blocks is then 

(li j ( l)i j X% j X2 ) j (Xj , X 1 j x '2 X2) . 

Thus the initial blocks are 

[(1)1 ;(-!).;(-» + i). ;(v - i)J, 

[2/1 ; -2/1 ; (2/ + i) 2 ; (-2/ - 1)2]; 

[(l ) 2 ; (-1)2 ; (-2/ + 1)3 ; (y - l) a ], 

[2/2 ; -2/2 ; (2/ + 1)3 ; (-2/ - 1)3]; 

[(1)3 ; (-1)3 ;(-2/ + 1)1 ; (2/ - 1 ) 0 , 

[2/3 ; -2/3 ; ( y + 1)1 ; (-2/ - 1)0; 

(00; o t ; 0 2 ; o 3 ). 
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The completion of the design is left to the reader. The de- 
signs constructed from Theorem 9.3 have for m = 1 the prop- 
erty that every variety occurs exactly t times in every position 
in the blocks. This is of importance if the position in the block 
has an effect on the yield. The analysis of variance of such 
designs, when the block position has an effect on the yield, is 
straight forward and is left to the reader. 

Of particular interest are the so-called symmetrical designs 
with v = b, r = k. From any symmetrical design two other 
designs can be obtained. The derived design obtained by re- 
taining in the blocks B 2 , • • • , B h only those varieties which 
are in B l and the residual design which is obtained by deleting 
from the design all the varieties in B , . In order to show that 
these configurations are really incomplete balanced block de- 
signs we shall show that every block has exactly X varieties 
in common with B t . From this result it follows that the derived 
and residual designs are incomplete balanced block designs with 
the parameters: k, v — 1, k — 1, X, X — 1 and v — k, v — 1, k, 
k — X, X respectively. 

As an example for the processes of residuation and derivation 
we shall consider the design 25, 25, 9, 9, 3. This design was 
constructed by Bhattacharya (Bull. Calcutta Math. Soc. 3G 
(1945) pp. 91-9G) and is not yet incorporated in the statistical 
tables of Fisher and Yates, which listed all incomplete balanced 
block designs with r < 10 which were known up to 1943. Bhatta- 
charya’s design is as follows: 

(9.20) 

1, 2, 5, 6,11,12,17,20,23; 

1, 2, 9,10,15,16,17,21,25; 

1, 2, 7, 8,13,14,17,22,24; 

3, 4, 7, 8, 9,10,17,20,23; 

3, 4,11,12,13,14,17,21,25; 


1,3, 5, 7,10,12,18,21,24; 
1,3, 9,11,14,16,18,22,23; 

1.3, 6, 8,13,15,18,20,25; 

2.4, 6, 8, 9,11,18,21,24; 
2,4,10,12,13,15,18,22,23; 
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3, 4, 5, 6,15,16,17,22,24 
1, 4, 5, 8,10,11,19,22,25 
1, 4, 9,12,14,15,19,20,24 

1, 4, 6, 7,13,16,19,21,23 

2, 3, 6, 7, 9,12,19,22,25 
2, 3,10,11,13,16,19,21,24 
2, 3, 5, 8,14,15,19,21,23 

17,18,19,20,21,22,23,24,25 


2,4, 5, 7,14,16,18,20,25; 

5.6, 9,10,13,14,17,18,19; 

5.7, 9,11,13,15,20,21,22; 

5.8, 9,12,13,16,23,24,25; 
7,8,11,12,15,16,17,18,19; 
6,8,10,12,14,16,20,21,22; 
6,7,10,11,14,15,23,24,25. 


From 9.20 we obtain by the process of residuation deleting 
all the varieties in the last block the design v — 16, b = 24, 
t = 9, k = 6, X = 3 as follows: 


(9.21) 


1,2, 

5, 

6,11,12; 

1,3, 

5, 7,10,12; 

1,2, 

9, 

10,15,16; 

1,3, 

9,11,14,16; 

1,2, 

7, 

8,13,14; 

1,3, 

6, 8,13,15; 

3,4, 

7, 

8, 9,10; 

2,4, 

6, 8, 9,11; 

3,4, 

11, 

12,13,14; 

2,4, 

10,12,13,15; 

3,4, 

5, 

6,15,16; 

2,4, 

5, 7,14,16; 

1,4, 

5, 

8,10,11; 

5,6, 

9,10,13,14; 

1,4, 

9, 

12,14,15; 

5,7, 

9,11,13,15; 

1,4, 

6, 

7,13,16; 

5,8, 

9,12,13,16; 

2,3, 

6, 

7, 9,12; 

7,8, 

11,12,15,16; 

2,3, 

10, 

11,13,16; 

6,8, 

10,12,14,16; 

2,3, 

5, 

8,14,15; 

6,7, 

10,11,14,15. 
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The derived design is a triple system with v = 9, b = 24, 
r = 8, k = 3, X = 2. 

We shall now prove that in a symmetrical design every block 
different from the first block has exactly X varieties in common 
with the first block. Let be the number of varieties common 
to the first block and the tth block i = 2, • • • , b. Then 

(9.22) E a, = k(r - 1) 

t 

since each of the k varieties of the first block occurs r — 1 
times in the remaining blocks. Also 

(9.23) E = (X - 1) 

since each of the [k(k — l)]/2 pairs of varieties of the first block 
occurs (X — 1) times in the remaining blocks. 

From 9.22 and 9.23 we get 

E a] - 2X E <*« + (f> - l)* 2 

i i 

= (X - l)k(k - 1) - (2X - 1 )k(r - 1) + (b - 1)X 2 , 
but b = v, k = r, k(r — 1) = X(v — 1) by 7.13 and therefore 
E (<L - X) 2 = —\k(k - 1) + X-X(i> - 1) = 0. 


Hence 

Oj = X. 

We finally observe that from every incomplete balanced 
block design B x , • • • , B b another incomplete balanced block 
design B[ , • • • , B' b can be obtained by putting into B[ all 
varieties not in 5,- . The parameters of this complementary 
design are: t;, b, b — r, v — k, b — 2r + X. 

R. C. Bose’s two theorems yield the following series of de- 
signs. Those derivable from them by derivation and residuation 
are not separately listed. 
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Desig- 
nation v b r k X 

T t 6< + 3 (2 1 + 1)(3< + 1) 3< + 1 3 1 

T 2 6< + 1 <(6< + 1) St 3 1 

(If v is the power of a prime or t odd.) 

D 1 + r r(l + r) r 3 2 

3 

[r(l + r) - 0(3)] 

Fi Ylt + 1 <(12* +1) 4< 4 1 

(12< + 1 is the power of a prime and in G.F.(12< + 1) 
there exists a primitive root x for which x*‘ + 
1 - x«, j - 1(2).) 

F, 12 1 + 4 (4< + 1)(3< + 1) 4< + 1 4 1 

(4< + 1 is the power of a prime.) 

G ! 20 1 + 1 <(20< +1) 5< 5 1 

(20< + 1 is the power of a prime and in G.F.(20< + 1) 
there exists a primitive root x for which x* 1 * 1 + 

1 = q ** 1(2) 

G 2 20< + 5 (5< + 1)(4< + 1) 5< + 1 5 1 

(4< + 1 is the power of a prime.) 

S, 4X + 3 4X + 3 2X+ 1 2X+ 1 X 


(4X + 3 is the power of a prime.) 
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Desig- 
nation v b r k X 

S[ (2X+l)(2X+2) (2X+l)(2X+2) + r2X + 2 2X + 2 X 
(X = 1 or X = 2.) 

S„ 2n(2nX + 1) 2n(2nX + 1) 2nX + 1 2nX + 1 X 

(v is the power of a prime p, x n ' — 1 = x Q< where 
Qt is a full residue system mod n, and the differences 
arising from n, , • • • , n„ mod p are symmetrically 
repeated each occurring once.) 

2X + 2 4X + 2 2X + 1 X + 1 X. 

A few designs in some of these series can also be constructed 
by means of finite geometries. For the details of the construction 
the reader is referred to R. C. Bose’s original paper. 

The series T, and T 2 do not, because of the restrictions on 
Ti and T 2 , contain all possible triple systems satisfying 7.12 
and 7.13 although it is known that all can be constructed. 
However they contain all triple systems within that range of r 
that has so far been found useful in the design of experiments. 
The series D contains all possible triple systems with X = 2. 
R. C. Bose made their construction dependent on the solution 
of two auxiliary problems, which were later solved by Bhatta- 
charya. (Sankhya V.6 pp. 313-314). The series , S[ , S n and 
some of the other designs yield further designs by residuation 
and derivation. Although many of the designs constructed by 
R. C. Bose had been previously obtained by other methods, 
some of them were constructed by him for the first time. All 
the designs with r < 10 known up to 1943 are tabulated in 
Fisher and Yates’ Statistical Tables. In these tables 12 blanks 
were still left, namely the following: 
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Number * 

V 

b 

r 

k 

X 

8 

15 

21 

7 

5 

2 

10 

22 

22 

7 

7 

2 

12 

21 

28 

8 

6 

2 

14 

29 

29 

8 

8 

2 

17 

16 

24 

9 

6 

3 

20 

25 

25 

9 

9 

3 

24 

46 

69 

9 

6 

1 

26 

21 

30 

10 

7 

3 

27 

31 

31 

10 

10 

3 

28 

36 

45 

10 

8 

2 

30 

46 

46 

10 

10 

2 

31 

51 

85 

10 

6 

1 


The impossibility of designs 8, 10, 14 has since been demon- 
strated by R. K. Nandi and Q. M. Husain in several papers 
which appeared in the 1946 issues of Sankhya.* The designs 
17, 20, 26, 27 were constructed by Bhattacharya. (Sankhya 
V 7 pp. 423-424). The last two as follows: 


‘Reference Number in Fisher and Yates Tables. 

‘In a forthcoming paper to appear in the Canad. J. of Math. Chowla 
and Ryser prove that a symmetrical design with even v is impossible unless 
k — \ is a square. This shows that also the design 30 is impossible. 
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The design (31, 31, 10, 10, 3) can be obtained from the 
blocks: 

5o — (li > 2i , 4j , 1* , 2j , , 1* , 2 3 , 4 3 , 0 4 ), 


B 1 — (It , 61 , 2 ^ , 52 , 3 3 , 4 3 , 34 , 54 , 64 , 00 1), 

Z?2 = (2i , 5 j , 3 a , 4 3 , I3 , 63 , 34 , 54 , 64 , 00 2), 

B 3 = ( 3 i , 4 , , 1 2 , 6 2 , 2 3 , 5 3 , 34 , 5 4 , 64 , 00 3). 


by forming the blocks B, s mod 7 and then adjoining the blocks 


B[ = (0i , li , 2i , 3j , 4i , 5i , 61 , 00 1 , 00 2 , 00 3 ), 

B 3 = (O2 , I2 , 2 2 , 32 , 4 2 , 5 2 , 62 , 00 1 , 00 2 , 00 3); 

S 3 = (O 3 , I 3 , 2 3 , 3 3 , 4 3 , 5 3 , 63 , 00 1 , 00 2 » 00 3 )- 

From this design the design (21, 30, 10, 7, 3) can be obtained 

by residuation. 

Although a great many designs are now available, necessary 
and sufficient conditions for the existence of an incomplete 
balanced block design with given parameters v, b, r, k, X are 
not known. Equations 7.12 and 7.13 are necessary conditions. 
The inequality 7.14 must also hold if v > k. We shall prove 
it now. The inequality b > v is, because of 7.12, equivalent 
to r > k. We number the blocks and consider the number o, 
of elements common to the first and the t'th block. 

From 9.22 and 9.23 it follows that 

E«! = Jfc([X - 1 ]k + r- X). 


From 9.22 it also follows that fc(r — 1 )/ (b — 1) is the mean 
of the variable a { and therefore 


(9.24) 


Ia!> 


k\r - l) 2 
b - 1 


(X - l)fc + (r - X) > ^ ? 
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From 7.13 we have (r — X) = rfc — \v and this substituted 
in 9.24 yields 

(9.25) fc(r - 1) - ^ ~ > X(» - fc) 

and 

(9.26) fc(r - 1) - X( ” " 


From 7.12 we have 

(9.27) 


6 — r _ r 
» — fc fc ' 


Since v — k > 0 we may divide 9.26 by v — fc and obtain 
on account of 9.27 

(9.30) r(r - 1) > X(6 - 1). 

Subtracting from this 7.13 yields 

(9.31) r(r — fc) > X(6 — i>), 

but (6 — v)/v = (r — fc)/fc by 7.12 and therefore 

(9.32) r(r - fc) > ^ (r - fc), 

(9.33) (r — fc)(fcr — Xr) > 0. 


Since fcr — Xr = r — X > 0 it follows that r > k. 


CHAPTER X 


/V on-orthogonal Data 

The r- way classification design wtih an equal number of 
replications in every subclass is the best available design for 
investigating the effect of classifications. However, it is not 
always possible to keep the numbers in the subclasses equal. 
Suppose for instance that we wish to measure the variation in 
the weights of pigs at birth according to sex and litter. It is 
of course not possible to prescribe the litter size and the number 
of males in a litter. Thus we obtain a two way classification 
design with unequal numbers in the subclasses. Such incomplete 
data may also result from the fact that originally a complete 
layout, say a Latin square was planned, but one or more 
experiments miscarried so that some observations are missing. 
Such data can also be analyzed with the help of the likelihood 
ratio principle but the computations are much more laborious 
than those described in the preceding chapters. 

The solution of all problems of this kind requires, as shown 
in Chapter IV, the finding of Q a and Q r — Q a . That is to say 
we have to minimize a quadratic form 

(10.1) Q = £ (y a - £ p iXia )\ 
under the restrictions 

k 

(10.2) 23 c «id,- = 0 u = 1, • • • , r < k rank (c„,) = r. 

J -1 

The minimum of Q with respect to the 0 { is denoted by Q„ 
if 10.2 denotes the restrictions imposed by the assumptions and 
Q r if 10.2 denotes the restrictions imposed by assumption and 
hypothesis. 

We shall prove the following theorem. 
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Theorem 10.1: Let S be the minimum of Q with respect to the 
j3„ under the restrictions 10.2. Let 

a v „ = X) »»«*«« for k > p > 0, k > q > 0. 

a — 1 

N 

(10.3) d Q 0 = doq = Va^qa ) 

a =• 1 
N 

Ooe ^ . 2/a • 


Then 

(10.4) 

where 


S = 


(10.5) A = 


«00 

Ooi 

Oo* 

0 

•• 0 

Oio 

On 

' ' Oi* 

C\\ 

• • C,i 


0*i 

• • Click 

Cl* 

* Crk 

0 

Cm • 

• ‘ Ci* 

0 

■ ■ 0 

0 

Crl • 

* * C r k 

0 

•• 0 


and A 00 is the minor of a 00 in (A) 

Applying the method of Lagrange operators we have 


(If) + i v. 


( 10 . 6 ) 


= 2 ( —a 0p + 2 a j>A/ + X) ^“ c 

\ 0-1 / U-l 


= 0, p = 1, • • • , fc, 

where as usual the caret denotes maximum likelihood estimates. 
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We multiply the pth equation by /§„ and sum over p. Since 
22p ft, = 0 this yields 

(10.7) — 22 a 0j Jp + 23 = 0. 

V V Q 

We now expand S and obtain 

s = a 00 — 2 23 a o P 3p + 22 22 flp«3p3« 

P-1 V Q 

( 10 . 8 ) 

= a,.o 22 flop3p • 

p 

Hence we obtain the following system of k -f- r -f- 1 equations 
for the k + r + 1 quantities 3o = 1, 3i , • • • , 3* , X,/2, • • • X r /2 ‘ 

(<s — a 0 o)3o + 22 «np3p = o, 


(10.9) - a 0v 3n + 22 a«3, + 22 ^ c„p = 0, p = 1, • • • , k, 


22 c«A = 0, m = 1, • • • , r. 

Since 3o = 1 this system has a non-trivial solution and it 
follows that 


S (loo 

floi 

Aol 

0 • 

•• 0 


fllO 

All 

flit 

c n 

• • C rl 



<1*1 

fltt 

Cu 

' ' c r * 

= 0 

0 

Cn 

Cit 

0 

•• 0 


0 

Crl • • * 

Crl 

0 

• 0 
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It follows that 


SA 00 - A = 0, S = 


In applying this result to an r-way classification one may 
use to advantage the following notation. Let 

1 if y a is in the 


( 10 . 10 ) 

{a) = 1, (a) - 

0 otherwise, 

where y, , • • • , y N are the observations. Then with , • • • ,i a 5 
a ix ,..., a ia ) defined as in Chapter V we have 


a fl , • • • , a jt class 
of the ii , • • • , i, 
classification 


( 10 . 11 ) 


«= z(y.- £ £ £ r 

a ' ^ = 0 1 , • • • , r a »i ®i/3 

'(«) o 4l ,••• , a i<( )) • 


n addition to the restrictions in 5.3 there may be other re- 
strictions imposed by the hypothesis. If A, A 00 , A', A( 0 are 
the determinants of Theorem 10.1 under the restrictions im- 
posed on the m(*i , •••»*; a,-, , • • • , <*«») under the assumption 
and the hypothesis respectively and if a and h respectively are 
the number of independent linear restrictions, then 

^ ~ l A ' /A A/~A»f A " 

has by Theorem 4.1 the F distribution and the test based on 
F is the likelihood ratio test. 

Although Theorem 10.1 yields very neat mathemetical for- 
mulae the numerical evaluation of A and A 00 , although feasible 
with modern computational techniques, is rather laborious. 
There are several cases in which the solution can better be 
obtained by operating directly on the least square equations. 

A special case in which the least square equations can easily 
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be solved directly is the case of an r-way design with propor- 
tional class frequencies in the subclasses. We shall indicate 
the treatment in the case of a two-way design. If the class 
frequencies are proportional we may write the number of ob- 
servations in the ith row and jth column (i = 1, • • • , r;j — 1, 
■ • • , k) as rii.n.j . 

It will be convenient to use the following definitions. 


Mil Mi/ 


Mi- = Mi- — 

(10.13) 

M-i - M-/ + 


M = M + 


E. 

^ i m ^ • m 

+ 

X '''e •mH'em 

E« E*«.. 

E. n.-M.. 

E.n.. + 

^ ->m W. m Mi m 



E™ n . m 



E« n .-M.i 




E. 

E- n - m 



E. W.-M.. + 

E» ri. m fi. m 

+ 



where m(1, 2; i,j) = Mi , , M (l; *) = Mt . , M (2; j) = in 5.3. 
It is easily verified that with these definitions 


E^-m.-,- = E^-fMo = = E n -.M./ = 0, 

* I » / 

(10.14) 

M.y + Me + M-i + M = Mi/ + Mi. + M-/ + M- 

Let Yui denote the Zth observation in the ith row and jth 
column and put 


Y i,. = 


rii.n.j , 


E Yu, , 


Yj.. = 


h- E> 


n.j 


E E r«« 

k l 


Y .,. 


1 

n.,' Ei«i- 


E E 

k l 


1 

Ei«i- E. ri., 


E E E 


y = 
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then the assumption may be written as E(Y in ) = n<i + 
Hi. + ti-i + M = M.t + Mi- + + M and the least square 

equations easily lead to 

Mil = Yu. - Yi.. - Y + Y, 

Yi.. - Y, 

Y.<. - Y, 

M = Y. 

Thus Q„ = E, E. E: (T,-,i - T./-) 2 . The Mii , Mi- , M-,- , 
H can be found from 10.13 utilizing the restrictions in 5.3. 



Mo 

^ ' m Mtm 

+ 

E« E» 

Mem 

Mil = Mil — 

r 

k 

rk 

1 


E. M.- + 

r 

^ Mtm 


E. E» 

Mem 

Mi- = Mi- — 

k 


rk 

» 

M-i = M-i + 

E« M.i 

^ 2m M*m 


E« E» 

M.m 

r 

k 


rk 

y 

M = M + 

E. M.- + 

r 

^ vm M • m 

a 

+ 

E« E- 

rk 

Mem 


The details of the derivations and the discussions of the tests 
of various hypotheses are left to the reader as an exercise. 

Sometimes one or more experiments of a complete layout mis- 
carry. It is then often still possible without excessive labor to 
solve the resulting least square equations. As an example we 
shall consider the case of an m sided Latin square in which 
only one observation is missing. We shall assume that this is 
the observation in the 1st row, 1st column and on the 1st 
variety. 


Mi- = 

(10.15) 

M-,- = 
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We denote by 7... , 7.<. , Y.. ( the sum of all observations 
in the ith row, ith column, ith variety respectively, and by Y 
the sum of all observations. Let r< , c, , v t , denote the least 
square estimates of the effects of the ith row, ith column, and 
ith variety respectively and v the least square estimate of the 
general mean. The least square equations resulting from 7.1 
are, on account of Theorem 4.5, 

Y + + Cj + Vi — (to 2 — l)u = 0, 

Y — TOr t + r, + Ci + v x — (to — 1)j; = 0, 


7.1. — TOCi + Ti + c t + Vi — (to — l)t> - 0, 


7..i — mv i + r x + Cj + v t — (to — l)v - 0, 


Y, .. — mrj — mv = 0, j = 2 • • • to. 

7., -. — mcj — mv — 0, 

7.. ,- — mVj — mv = 0. 

From the first equation we obtain rj + i>i + = (to 2 — l)r — 

7. Substituting this in the following 3 equations we find: 

mr x = 7i.. + to(to — l)v — 7, 

toci = 7-i. + to(to — l)r — 7, 

to^i = 7..! + to(to — l)u — 7, 

Thus to(to 2 — 1)« — to 7 = 7i„ + 7.J. + 7.., + 
3 to(to — l)v — 37. Hence 


7„. + 7.i, + 7.., + (to - 3)7 

to(to — 1)(to — 2) 


v 
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Thus finally 

(m - 1)F,.. + 7„. + 7.., - 7 

1 m(m — 2) 

= F,.. + (TO - 1)7,!. + 7.., - 7 

Cl m(m — 2) 

= 7,.. + 7 + (m - 1)7.., - F 

1 m(m — 2) 

and for j > 2 


7,.. _ 7i.. + 7,!, + 7,, i (m — 3)7 


m 

m(m — 1 )(m — 2) 


7.,.. 7j. 

. + 7.,. + 7.., + (to - 

3)7 

m 

m(m — 1 )(m — 2) 


7..,. 7j. 

. + 7.,. + 7.., + (m - 

3)7 

m 

m(m — 1 ){m — 2) 



In testing the hypothesis v,- = 0 (j = 1 ,■■■, m) one obtains 
an analogous result for r,- and c,- . The test of the hypothesis 
Vj = v k is best carried out by utilizing Theorem 4.3 and its 
corollary. The details of the analysis are left to the reader. A 
detailed discussion of the analysis of Latin squares when some 
observations are missing is given by D. B. DeLury (Journal of 
the American Statistical Association, Vol. 41, pp. 370-389). A 
general method for the treatment of missing observations was 
given by F. Yates (Empire Jour. Experimental Agric., Yol. I, 
1933). 

Yates proceeds as follows: Suppose we have a regression 
equation 

a 

(10.17) E(y a ) = X) Pi a = 1, • • • , n 

• - 1 

and suppose further that the observations , • • • , y h are 
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missing. Differentiation of Q = (y a — <7,„/3,) 2 with 

respect to the /3,- yields the least square equations 

(10.18) £ = 2] X) (* - i, ••• , *)• 


Differentiation of Q with respect to y x , • • • , y k which we also 
regard as unknown parameters yields the additional equations 


(10.19) 


y a = ]C fl'ia/Si , ol = 1, • •• , k. 
1 


We may first solve 10.18 for the j§,- and then substitute the 
values of /§< so obtained into 10.19. Thus we obtain k equations 
for the k unknown quantities y x , ■ • • , y k and the solutions to 
these equations are the least square estimates of y, , • • • , y k . 

This method is particularly advantageous in the case of de- 
signs where the expressions for the are already known. 

We shall exemplify Yates method in a Latin square with one 
observation missing. We obtain from 7.2 and 10.19 for the least 
square estimate ? lu of F nl 


f 


111 


3f m ( 7,.. + Y .i. + 7.., 
m m 


2f, 


m 


2 Y 


TO 


m 2 Y x ,. + r.„ + y..! 2F 

111 (m — l)(m — 2) m m 2 

Substituting f m for F 1U in 7.2 one then obtains equations for 
v x , Ci , Ti . The reader may verify that these equations are the 
same that were previously derived by a diiect application of 
the maximum likelihood principle. 


CHAPTER XI 


Factorial Experiments 

It will be convenient in this as in the previous chapters 
to use the picture of an agricultural field experiment. This is 
done to give the reader a concrete picture but should not be 
taken to imply that the use of the designs presented is restricted 
to agricultural experimentation. 

Suppose that the influence of m factors, say m different 
fertilizers, on the yield of wheat is to be tested. Each of these 
factors may be applied on different levels. Let the fth factor 
be applied on t { levels, so that all in all M 2 • • • t m treatment 
combinations are possible. 

If we consider the tth level of the ath factor as the fth class 
of the ath classification in an m way classification design, we 
can use the methods of analysis of Chapter V. The estimates 
of the main effects and interactions A(l, • • • , a; a k , • • • , a a ) 
appearing in 5.5 are linear forms of the observations of the 
form 

(11.1) Z ••• E 1, ••• ,«;.&! , ••• , &.), 

bi b a 

where x(l, • • • , a; b t , • • • , b a ) is defined as in Chapter 5. 
We proceed to compute the coefficient of x(l, • • • , s, s + 1, 

• • • , a; a, , • • • , a, , b, +1 , ■■■ , &«)(&; 5^ O/) in A{ 1, • • • , a; 
aj , • • • , a a ). This term occurs as a summand in all x(ki , • • • , 
k e ; a kl , • • • , a k) ) where k x ■ ■ ■ , kp is a combination out of 1, 

• • • , s and it occurs there with the coefficient (f tl • • • t ks )/ 

(b • • • t a ). Hence using the notation of Chapter 5, the coefficient 
of x(l, * * j Sj s d - 1, • * ■ , otj (L\ , * * * , 1 b a+ i , , 5 a ) in 

A( 1, • • • , a; di , • • • , a«) may be written as 

a— 0 ft, * Lfl 

f 1 " ' ' t a 


E E(- 

0=0 
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Thus 


E i.„ 


• • ' ,agc , +xb t + a , 


( 11 . 2 ) 


a 

E E 

fl-o 






i) 


+ E E(-i)-'^ 


ii4 
*« ' 


By splitting the second term on the right side of 11.2 into 
terms for which kp = s + 1 and terms for which kp < s + 1 
one obtains E«.+. la,--a.<,. + 1 h. + ,— b „ = 0. Similarly one proves 
that the coefficients l bx ... ba appearing in 11.1 satisfy the equation 

(11.3) E = 0 i=l, •••,«. 


We generalize the concept of interaction and define: Any 
linear form 

(If *4) T fo, , • • • ,a a ^(fi , * * * , f o , a, , * * * , a„) 

a i a a 

which is not identically 0 will be termed a component of the inter- 
action between the factors i b , • ■ ■ , i a if 

(11.5) E la,. ■■■.a. =0 i = 1, • • • , a 

a | 

for all choices a b • ■ • a { ^ a i+ , ••• a„ . 

Two linear forms 

n n 

E a ^k and E M/ 

*=1 i-l 

are called orthogonal if 

(11.6) EaA = 0. 

k=l 

Theorem 11.1: Two interaction components G and H belonging 
to two different sets of factors are orthogonal. 
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We may always arrange the notation so that G is a com- 
ponent of the interaction of the factors 1, 2, • • • , u and H 
of the factors p, p + 1, • • • , v where p > 1. Let 


G = 

22 ’i<*x a = 

a 

E ••• 

Oi 

E L„... 

a M 


t/rj Ctl > 

> d u ) , 

H = 

22 is*- = 

a 

22 ••• 
a p 

E L.... 

a» 

,«.z(p, • • • . 

| yj dp , 

• , a,)- 

If 

= 

then l a 


,Au + l * * * tn 

, . Thus writing 

W = ] 

max ( u , v) 






(11.7) 

E 

a 

a - «■ 

• • • 0«, 

(^1 

^w)(^u> + l 

L • • • U 2 

• • • o 





E ••• 

oi 

E E 

a to oi 

« • ‘.Ott^Op, • • • , 

.. = o 


by 11.5. 


Lemma 11.1 : If L x , • • • , L, are orthogonal to L then 22 ■ 
is orthogonal to L for all values \i , • • • , X, . 

The proof of Lemma 11.1 is left to the reader. 

Solving the equations 11.5 we may choose arbitrarily the 
quantities l ai ... a „ for a, < 7, — 1. The equations 11.5 can 
then be satisfied by putting successively 

<i-l 

It, Oj. •••,«« = — 22 > a 2 < <2 ) ' ‘ ■ ) a„ < ta > 

a i*=l 
<i-l 

Lii ,, •••,*„ = — 22 • ••.<■« i a 3 < t 3 , • • ■ , a a < t a , 

a a ™ 1 


< a-1 

7 = _ V / 

•'ai »•••,<* a — l < a / > ■'Oidj, 4,, i(io * 

<*a*l 

Thus the equations 11.5 have exactly (<! — 1) • • • (<« — 1) 
independent solutions. That means that every solution of 11.5 
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can be expressed as a linear combination of any (£, — 1) • • • 
(t a — 1) linearly independent solutions. By the method used 
in the proof of lemma 4.1 we can therefore find a system S 
of (<i — 1) • • • (t a — 1) normalized orthogonal linear forms 
such that every form in S is a component of the interaction 
between the factors i t , • • • , i a and such that every component 
of such an interaction is a linear combination of forms in the 
system S. 

The interaction components of different factors are orthogonal 
to each other and hence linearly independent. Thus together 
with the mean we obtain 

m 

1 + X H - i) • • • (t tk - i) = ut 2 

1 1 , • • • , m 

independent linear forms and therefore any linear function of 
the observations may be expressed as a linear combination of 
the mean and any set of (U ■ • • t m ) — 1 linearly independent 
interactions. 

In considering the analysis of factorial designs we may 
therefore consider the following general problem. Given n 
normally distributed random variables x t , • • • , x n all with 
the same variance but different means. We know that certain 
linear forms in ■ ■ ■ x„ 

n 

(11.8) L k = X a uXi i — 1, • • • , s 

1-1 

have the mean value 0. We wish to test, whether certain other 
forms 

n 

(11.9) Li — ciijXj i = s + 1, • • • , r 

J-l 

also have mean value 0. 

In the first place we may eliminate, from the assumption 
and hypothesis successively, forms such that L, , • • • , L, , 
L .+ 1 , • • • , L r may be assumed to be independent. Next we 
may orthogonalize and normalize the assumption and hy- 
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pothesis by the method used in the proof of lemma 4.1. We 
may then add n — r linear forms 

n 

L ( = X) a u x i i = r + 1, • • • ,n. 

i-i 

such that the matrix 

/• 

dn * * * fli„ 


* ®nn> 

is orthogonal. Then 

Q = Z (z. - L(*i)) 2 = E (Li - L(L,)) 2 

i-1 »-l 

Thus 


Q a 


EL 2 

i-1 


Q r - Q a = E L 2 and F = 

i = a + 1 


S Qr ~ Q* 

r - s Q„ 


is the likelihood ratio statistic for testing the hypothesis 
E(Li) = 0(i = s + 1, • • • i r) under the assumption L(L.) = 0, 
(i = 1, ■ i s)* 

In the analysis of factorial experiments we shall always put 


T _ Xl + ' ' ‘ + X " 

Li - n ./2 

so that the sum of the coefficients of L 2 , • • • , L„ is 0 because 
of the orthogonality. 

We then consider the mean yield 2?(x,-) as composed of the 
treatment effect T { and the block effect b a due to the soil 
fertility of the ath block. The experiment is replicated in h 
different blocks each containing a complete replication of all 
treatments. We shall denote by x“ the value observed under 
the fth treatment in the ath block and put L,“ = 

Li(x“, ••• , x“). Then since Lf = (x“ + • • • + Xn)/n l,i we 
see that E(L“) = L,(Ti , • • ■ , T n ) = S { for i = 2, • • • , n 
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and E(L“) = L l {T l , • • • , T H ) + n 1/2 b a ^ S, + n 1 ' 2 b a . 
Let Lt be the mean of all L“ then 

Q = ±±(x°-Ti- b a y 


= EE 

a = 1 i = 2 


(L“ - Li y + h £ (Li - Si ) 2 


+ E ar -s t - n i/ 2 b a y. 

a = 1 

If we now test the hypothesis S k+1 = • • ■ = S k+U = 0 under 
the assumption S 2 = • • • = S k = 0 then 


Q* = E E (i.“ 

a = 1 t-2 


- l ,) 2 hil:, 


t-2 


Qr-Q a = h E ■ 

*-* + 1 

Thus Q„ has (k — 1) + (h — l)(n — 1) degrees of freedom 
and Q r - Q a has u degrees of freedom. Note that more than 
one replication is needed unless certain of the *S', are known 
to be 0. 

We recall that one of the necessary assumptions of the 
analysis was the uniformity of the soil. If the number of treat- 
ment combinations is large then the blocks become too large 
to make this assumption. In this case one conducts the ex- 
periment in several blocks containing among themselves a 
complete replication and resorts to the technique of confound- 
ing linear forms of the treatment effects in which one is not 
interested. 

A linear form 

S = E aiTi 

t -1 

will be called confounded in the block B a if a,- = c a whenever 
Ti is the effect of a treatment applied in the ath block B a . A 
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linear form S will be called orthogonal to B a if Z a. = 0- 
A linear form S = Z< a,T, *’« called normalized if Z< a< = 1. 

Lemma 1 1.2: // <S, , • • • , S, are confounded in the block B 
then any linear function S = X 1 S 1 + • • • + \,S, is also con- 
founded in B. 

The proof of Lemma 11.2 is left to the reader. 

Lemma 11.3: If L x , • ■ • , L„ are n orthogonal functions of the 
variables Xi , • • • , x n and L is orthogonal to L l then 

11.10 L = a 2 L 2 + • ■ ■ + a n L„ . 

Proof: Since L x , , L„ are independent we certainly have 

L = aiZ/i d~ ■ ■ ' d - a„L n . Let L = Z)* XjX,- , Li, 53* Xt<£< 
then Z» X;X„i = Z* a * 2,- X t ,X„j = a„ Z> X U ( . Thus 

Z. x ( Xu, 

(11.11) ^ • 

Since L is orthogonal to L x we must have «, = 0. 

Theorem 11.2: If S x , S 2 , ■■■ , S n is a system of orthogonal 
linear forms in the treatment effects Ti , • • • , T„ and S, , S 2 , 

• • ■ , S v are confounded in the blocks B x , • • • , B, consisting of 
a complete replication of the treatments, then S, +l , • • • , S n are 
orthogonal to these blocks. 

Proof: Let S' (i = 1 ■ ■ ■ v) be the sum of the treatment 
effects of all the treatments in the ith block then S, , • • • , 
S, are linear functions of Si , • • • , S{ . However since S, , 

■ ■ ■ , S, are independent we may express <S[ , • • • , S', also by 
Si , • • ■ , S, . Therefore by Lemma 11.1 £( , ■■■, S' are orthog- 
onal to S v +i , ■ • • , S„ . 

Suppose now that we are interested in certain linear functions 
S , + 1 , • • • , S v+k of the treatment effects T t , ■ , T n ,n = u-v, 

and wish to arrange our experiment in v blocks of u treatments 
each. We may assume that S, +l , ■■■ , S v+t are normalized and 
orthogonal to each other. We first add forms Si , • • • > S, , 
Sv+t+ i , ■■■ , S n in order to obtain a set of n normalized orthog- 
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onal forms. Suppose that we can find an arrangement of the 
treatments in v blocks such that Si , • • • , S v are confounded 
in all the blocks. Then S, +l , • • • , S„ will be orthogonal to all 
the blocks by Theorem 11.2. 

Let y a denote the yield of the ath plot and consider 

(11.12) Q = £ (y„ - T a - b ia )\ 

a = 1 

where T a is the effect of the treatment applied to the ath plot 
and b ia is the effect of the block in which the ath plot lies. Let 
S a = £0 tafsTt and put L a = £„ t at y, . Then 

(11.13) Q = £ (L„ - S a - £ t a ,b it )\ 

a 0 

If L a is orthogonal to all the blocks then £„ t a pb it = 
23i//ic Bj — 0. If L a is confounded in all the blocks 

then t a „ = c„j whenever i f = j. Hence 

(11.14) ^ tcpbif = u 23 Cajbj . 

» i 

But the linear forms L, , • ■ • , L, are orthogonal and therefore 
the matrix (c a ,) is an orthogonal matrix and hence non- 
singular. We can therefore always solve the system of equations 

L a S a U ) ) C a jbj CL — lj * • • t v 
j 

whatever the value of S a . Thus in minimizing Q under certain 
assumptions on S, +1 , • • • , S. +k with respect to the S a and 6,- 
we may always choose the b { so that the first v terms of 11.13 
vanish. We therefore heed only minimize 

(11.15) Q' = £ (L„ - Sa) 2 . 

a — v + 1 

The same argument also applies if the experiment is replicated 
several times. We shall formulate this result as 

Theorem 11.3: Let a;, , ■ • • , x u , be uv observations from v 
different blocks Bj , ■ ■ • , B, of u observations each obtained in 
applying the treatments T t , • • • , T u , respectively. Let S t , ■ ■ ■ , 
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S u , be uv normalized orthogonal forms S a = E 0 t a $T $ in the 
treatment effects T t , • • • , T„» and assume that S 1 , ■ ■ ■ , S, are 
confounded in all blocks. 

If the hypothesis S a = 0, a = v + k + 1, •••,» + ft + 8 
is tested under the assumption S a = 0,a = t>+l, •••,» + ft, 
E{x a ) = T a + bi. , then 


Q. = Zi 


2 

o J 


Qr~Qa = 


t> + fc+8 


E 


L*. 




where 

L fi t afi Xf> . 

0 

// the experiment is replicated r times and L ai is the value of 
L a in the ith replication then 

Q a = r E L\+ £ E (L „ 4 - L„) s , 

a=»+l a=»+l t*l 

( 11 . 16 ) 

» + fc + s 

Qr ~ Qa = r E » 

® + fc + l 


where 

L a = - E L ai . 
r i - 1 

Thus if we are interested in the linear forms S,+i , • • ■ , 
S v+k and wish to arrange the treatments T x , • • • , T uv into v 
blocks we have to find v linear forms <S\ , • • • , S„ orthogonal 
to (S„+i , • • • , S,+ t and a design with v blocks where Si , ■ ■ • , 
S, are confounded in all the blocks. Since the mean is always 
confounded this can only be possible if <S r „+i , • • • , S, +k are 
orthogonal to the mean, that is to say if the sum of the co- 
efficients of <S„ +l , • • • , <S„+* vanishes. 

In the case of a factorial experiment the method of attack is 
as follows. If S a = Es W 2 * then we first form the linear 
forms L a = . Let h , ■ • • , h, be a complete normalized 

system of interaction components as constructed at the be- 
ginning of this chapter. Then 
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(11.17) L a — Uaplp a = v 1, ••• , v k 

P 

with certain values of the u af . If it is possible to confound v 
interaction components which have the coefficient 0 in all 
equations of the system 11.17, then L a and thus also S a 
(a ■= v + 1, • • • , v + k) will be orthogonal to all the blocks 
by Theorem 11.2. The L a are by Theorem 11.1 and Lemma 
11.1 orthogonal to all the components say 7, , • • • , 7 r of Inter- 
actions which do not enter in 11.17. The L a may then be 
orthogonalized and normalized so that Theorem 11.3 applies. 
If the experiment is replicated we may have to add some 
functions of the interaction components I r+1 , • • • , I u , to 
obtain a complete normalized orthogonal system. 

The linear forms of interest to the experimenter are usually 
the main effects and 1st order interactions themselves or linear 
combinations of them. Thus it is important to construct 
designs where only interactions of order 2 or higher are con- 
founded. The problem of constructing such designs when all 
factors are at two or three levels respectively was solved by 
F. Yates (The Design and Analysis of Factorial Experiments, 
Technical Communication No. 35, Imperial Bureau of Soil 
Science). Yates’ publication contains also many examples and 
presents in detail efficient methods of computation applicable 
to factorial designs. The more general problem of confounding 
only interactions of order 2 or higher in designs where each 
factor is at s levels and s is the power of a prime p was first 
solved by R. A. Fisher (Ann. of Eugenics (1945) 12, pp. 376- 
381). An alternative method has been given by Radhakrishna 
Rao (Sankhya 11 pp. 67-78). In the following we shall present 
Rao’s method. 

Let a 0 = 0, a x = 1, « 2 , • • • , a„_! be the elements of G.F.(s). 
Denote the levels of the factors by <*„ , • • • , and let 
3/(“o ’ ‘ ‘ «0 be the observations with the first factor at the 
a,-, st level, the 2nd factor at the a,-, nd level and so on. Con- 
sider then for every a, the set of observations y xx ... x „ where 

j • • • , x it satisfy the equation 
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(11.18) M.-, + • • • + b k x xk = otj , 

j = 0, • • • , s - 1, &! ^ 0, • ■ • , b k 0. 

Corresponding to the s different values of a,- we obtain s sets 
of observations M i , • • • , M, and each observation is contained 
in exactly one of the M, . Consider now any orthogonal matrix 
\u(i, j — 1, • • • , s) whose first row is (s~ 1/2 , • • • , s~ 1/2 ). Let 
Ti , • • • , T. stand for the sum of all observations y Xi ... Xm 
whose indices satisfy the equation 11.18 with j = 0, • • • , 
s — 1 respectively and consider the expressions 
8 

(11.19) Li = £ A U T, i = 1, ••• ,s. 

J = 1 

We shall prove that L 2 , • • • , L, are all components of the 
interaction between the factors i x , • ■ ■ , it ■ All observations 
with any fixed values x it , • • • , x ik must lie in T , if one of them 
does. Hence L ( = X ^uTi are linear forms in the means 
y(ii , • • • , i k ; x it , • ■ ■ , x ik ). Keeping now x i% , • • • , x ik fixed 
and summing over the coefficients of y(i k , • • • ,i k ;x tI , ■ ■ • , x ik ) 
with respect to x ix we obtain Xj because if x ix takes all 
values a 0 , ■ • • , a.-i then a, in 11.18 takes all values in G.F.(s). 
Since X. x .; = 0 for i = 2, • • • , s, 11.5 is fulfilled and the 
Li i > 1 in 11.19 are therefore components of the interaction 
between the , • • • , z' t th factors. There are (s — 1)* 1 systems 
of coefficients b k , ■■■ , b k leading to different functions L 2 , 

• • • , L, since <rb x , • • • , ab k leads to the same functions as 
6, , • • • , b k . Thus there are (s - 1)‘ different interaction com- 
ponents obtained by taking all possible values for b k , • ■ ■ , b k ■ 
That they are independent of each other and hence give a 
complete system of components of the interaction between the 
factors i k , • • • , i k will be- proved by showing that two inter- 
action components belonging to two different coefficient sys- 
tems are orthogonal to each other. Consider then 

(11.20) b,Xi, + • • ■ + b k x ik = oti , 

CiXi, + • • • + c k x ik = a,- . 


( 11 . 21 ) 
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Since the matrix 


&i ) * ' ' > b k 


pi j ) Ckj 


is of rank 2 there is at least one 2 by 2 submatrix of rank 2. 
Suppose therefore that 


bi b 2 


^ 0. 


Ci c 2 


Then we may fix x it , • • • , x ik arbitrarily and this completely 
determines , x 2 . Hence we obtain exactly s*~ 2 points 
(x, , ■ • • , x k ) which satisfy 11.20 and 11.21 simultaneously. 
Thus if T i , • • • , T, are the sums of all observations satisfying 
11.20 for i = 0, • • • , s — 1 resp. and U 2 , • • • , U, is similarly 
defined for 11.21 and if L, = X„T # = = 

Z-<> X,,d7 # = . Then since = Owe must have 

(11.22) Z = s‘" 2 Z Z X„X„ = 0. 

« J l 

Thus Li is orthogonal to L[ . We shall state this result as a 
theorem. 


Theorem 11.4: Let (b x , ■ • • , b m ) be any set of m elements of 
G.F.(s), not all 0, and consider the sets M k of points (xi , ■ ■ ■ , x m ) 
in E.G.(m, s) satisfying the equation 

biXi + • • • + b m x m = a k 

resp. where a 0 , , a.. x are the marks of G.F.(s). Let 

( x i , ‘ ‘ , x m ) stand for the treatment combination having the ath 
factor at the level x a and let (X,-,-) be an orthogonal s X s matrix 
whose first row is (1 /s 1/2 , ■■■ , l/s 1/2 ) and let T k be the sum of 
all observations y Xl ... x „ where (x, , • • • , x m ) is in M k . Then 
the functions Li = Z/ X.,7 1 , are components of the interaction 
between the factors i x , • • • , i k if b ia ^ 0 (a = 1, • • • , k) and 
bj = 0 forj i a ,{cx= 1 , • • • , k). 


151 


The interaction component L ; vnll be said to correspond to the 
point (&!,•••, b m ) of P.G.(m, s). Two interaction components 
corresponding to different points are orthogonal. 

We consider the solutions of the system 

b ix Xi + • • • + b im x m = a*,- , 

(11.23) i = 1 • • • u < m, rank (&,-,) = u. 

Xi , b u C G.F.(s). 

There are s m '“ solutions for x k , ■■■ , x m . If we solve 11.23 
for all combinations ( a k , , • • • , «*„) we obtain s“ sets of s 
treatment combinations each. If these are taken as the contents 
of s” blocks then the set of interaction components corre- 
sponding to any linear combination • , b im ) will 

be confounded in all the blocks. Thus (s u — l)/(s — 1) sets of 
interaction components will be confounded giving (s - 1) 
( s “ _ l)/(s — 1) = s“ — 1 or with the mean s“ independent 
orthogonal functions confounded. The remaining ones are 
orthogonal to all the blocks by Theorem 11.2. 

We wish to confound only interactions between at least 3 
factors. We put u = m — t and assume that m < (s' — 1)/ 
(s - 1). There are (s‘ — l)/(s - 1) linear forms in the variables 
Xi , • • • , x, with coefficients in G.F.(s) independent in pairs. 
From these we choose m and each of these forms will now be 
identified with a factor. We then consider all points (xt , ■ • ■ , x , ) 
where x x , ■ • • , x, are elements of G.F.(s). Let 

t 

(11.24) Li = X) t = 1, • • • , to 

k= l 

be the m linear forms chosen. In substituting the points 
(x t , • • • , x,) we obtain 

t 

(11.25) a ik x k = Vi . 

k-1 

Thus we obtain a set S of s‘ points of E.G.(m, s). We shall 
show that 
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1 ■) S is a subspace of E.G. (m, s). 

2.) To every pair y t , y, i, j < m there are exactly s‘~ 2 points 
in S which contain both ?/,- as zth coordinate and y, as jth co- 
ordinate. 

^ Proof of 1 . Let y x , • ■ • , y m ; z k , • ■ • , z m be two points in S. 
Then there are two points (xj 1 ’, • • • , x ( U) ) and {x[ 2) , ■■■ , x\ 2) ) 
in E.G.(£, s) such that 



hence 

X aafol 1 ’ + x[ 2) ) = \y { + . 

k 

Thus {Xt/j + yz, } is a point of S which proves 1. 

The number of points in S containing y { as ith coordinate 
and y ,■ as jth coordinate is the number of solutions of the 
equations 

t 

L < = 2 a <kX k = yi , 

(11.26) 

t 

L> = 22 a ikXk = Vi . 

* = 1 

Since L, and L, are independent there are exactly s‘~ 2 solutions. 
Thus 2 is proved. 

The point (0, 0, • • • , 0) is in S. Let the point {y x , • • • f y m ) 
correspond to the experiment where the fth factor is on the 
2 /ith level, where the elements of G.F.(s) are numbered in 
some arbitrary way. Let the blocks be constructed as follows. 
Take S as the initial block. To obtain the second block take 
any point P not in S and add it to all the points in S. We 
shall denote the second block by (S + P). If there is a point 
Q left which is neither in S nor in (S + P ) form ( S + Q) and 
continue the process until all points of E.G. (wi, s) are exhausted. 
Since S is a subspace it follows easily that any two sets (S + P ), 
(S + Q ) are either identical or have no point in common. Thus 
the sets obtained by our construction have no point in common. 
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If the interaction components belonging to b 1 , • • • , b m are 
confounded in S then for all points (y x , • • • , y m ) in S we must 
have, since S contains the point (0, 0, • • • ,0), 

E>i2/i + • • • + b m y m = 0. 

Let the element z, , • • • , z m be an element of (S + P) then 
bi(yi + Zi) + • • • + b m (y m + z m ) = b x z x + • • • + b m z m = 
const. The confounded interactions form the space orthogonal 
to S whose dimension is m — t. Thus s m- ‘ interactions are con- 
founded. We shall show that only interactions between at least 
three factors are confounded. Otherwise we should have a b t 
and bj not both equal to 0 such that 

(11.27) &d/.- + b t yi = 0 

for all points in S. But S contains a point with z'th coordinate 
1 and jth coordinate 0. Hence 6, = 0 and similarly !), = 0. 
Thus only interactions between more than 2 factors are con- 
founded. 

As an example we shall arrange the 27 treatment combina- 
tions of a three way experiment with every factor at three 
levels into 3 blocks of 9 each so that only interactions between 
3 factors are confounded. We first have to find three independent 
linear functions of two variables, for instance 

x,y,x + y. 

Next we substitute the points of E.G.(2, 3) into these lines 
giving us the subset S of E.G.(3, 3) or the initial block of our 
design 

S = {000, 011, 022, 101, 112, 120, 202, 210, 221} 

The other two blocks are obtained by adding, mod 3, the points 
111 and 222 to S 

S + 111 = {111, 122, 100, 212, 220, 201, 010, 021, 002} 

S + 222 = { 222 , 200 , 211 , 020 , 001 , 012 , 121 , 102 , 110 } 
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To find the confounded interactions we choose two inde- 
pendent points in S, for instance, Oil and 101, and solve the 
equation 

a-0 + 6-1 + C-1 = 0 


a- 1 -f- 6-0 + c- 1 = 0 


We obtain the solutions (a, b, c) = (112), (221). Thus only the 
two interaction components corresponding to (112) and the 
mean are confounded giving 3 orthogonal functions confounded. 

Rao gives in his paper a more general method by which it is 
often possible to confound only interactions between more than 
d factors where d may be larger than 2. 

If all treatment combinations are replicated in several sets 
of blocks each containing a complete replication, it is also 
possible to confound some functions in some of the replications 
and to leave them unconfounded in others. This technique is 
known as partial confounding. The analysis of partially con- 
founded designs is given by formulae analogous to 11.16, where 
however, L a is the mean value of L„ over those blocks where 
T a is unconfounded and the sum 

E C L m{ - L a ) 2 

*-l 

extends only over the same blocks. 

F. Yates has in his previously mentioned publication given 
various designs where not all factors are at the same number 
of levels and some of the main effects and interactions between 
2 factors are only partially, but never totally, confounded. 


CHAPTER XII 


Randomized Designs, Randomized Blocks, 
and Quasifactorial Designs 

The use of orthogonal Latin squares and balanced in- 
complete block designs is only possible if the number of 
varieties, replications, and the block size fit into one of these 
designs. In cases where no suitable design of these two types 
can be found it is necessary to use other designs, some of which 
will be discussed in this book. This usually entails a loss in 
efficiency and sometimes also of mathematical precision. 

A design which can be accommodated to any number of 
varieties, any block size, and any number of replications can be 
obtained by arranging the varieties randomly over a field. 
The assumption of the underlying linear hypothesis is then 
given by 


R ( ya ) = *>< + Vi + M + «ii , 2 v i ~ X V , = 0) 


where y {i is the yield of the ith variety in the jth block, »< 
is the effect of the ith variety, j the effect of the jth block, 
fi the general mean and the «,■,■ are normally and independ- 
ently distributed variables with mean 0 and the same but 
unknown variance. Since the varieties are assigned at random 
to the blocks, the block effect ??, becomes a random variable. 
However, t;,- takes if the blocks are of equal size any of b 
values, 6, • • • b b , with equal probability and therefore we 
cannot assume that y — y,, — v t — y is normally distributed. 
Also + = cr,,,, . If the blocks are of equal size 

each containing 1c varieties then 



f 1 if e = m 
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Hence 





m 


-s. V 

b(bk - 1) - 


Hence the y' u are not independent. Thus it is not quite correct 
to treat such a design as a one way classification design, the 
classes being the varieties, as is usually done. The objections 
raised against this treatment are not serious if the sample is 
large, but may affect the size of the critical region for small 
samples. It must be admitted that one intuitively feels that a 
minor deviation from the assumptions will not greatly influence 
the distribution of F. A rigorous study of the deviation of F 
as computed from such randomized designs from the distribu- 
tion computed in Chapter I has not been made. The theoretical 
statistician should not overlook the fact that it is immaterial 
to the practical research worker whether the size of his critical 
region is exactly 5% or 1 or even 2% more or less. At any rate 
he cannot veto the use of slightly inaccurate methods as long 
as he has not succeeded in replacing them by accurate ones. 

A rigorous treatment of the randomized design is possible 
if we consider not block but plot effects and regard these as 
chosen at random from a normal population of plot effects. 
Under these assumptions we may treat the design with com- 
plete rigor as a one way classification design. We are then 
ignoring the fact that neighboring plots have similar plot 
effects. Thus we are intentionally using a mathematical model 
which we know to be slightly different from the true situation. 
In this procedure we do, however, not differ from the physicist 
who computes the laws of a freely falling body and intentionally 
disregards air friction. One should also be aware of the fact, 
that our customary assumption of normality is at best an 
approximation to the truth. 

An improvement over complete randomization is the ar- 
rangement of the varieties in randomized blocks. In this ar- 
rangement all varieties are replicated in each block and the 
design is then treated as a two way classification design by 
blocks and varieties. We then have to assume that the soil 
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fertility within the blocks is uniform. The position within the 
block is chosen at random for each variety. 

In all designs which are based on randomization only, the 
block effects increase the error very considerably and in most 
cases a systematic arrangement, if available, is preferable. 

In recent years the quasifactorial designs, particularly lattices 
and lattice squares, have become very popular. In these designs 
the techniques of partial confounding are utilized. As an 
example suppose that we have q t q 2 varieties. These are arranged 
into a rectangle of q 4 rows and q 2 columns for instance for 
<?i = 3, $ 2 = 4. 

V n • ■ • V 14 

( 12 . 1 ) 


V n • • • F 34 . 

Two sets of blocks are formed. The first set contains qi 
blocks of q 2 varieties each. The varieties in these blocks are 
those occurring in the 1st, 2nd, • • • , g,st rows of the rectangle. 
The second set of blocks contains q 2 blocks with q x varieties 
each and the blocks contain the varieties in the 1st, 2nd, • • • , 
g 2 nd column of the rectangle. Thus from 12.1 one obtains the 
following blocks: 

(Fu , F„ , F 13 , Fu), (F 21 , F 22 , F 23 , F 24 ), 

(F 31 , V 32 , V 33 , F 34 ), 

(Fu , F 21 , F 3 l), (F 12 , V 22 , F 32 ), 

(Fi. ; V 23 ) F 33 ), (F 14 , F 24 , F 34 ). 

The whole design may be replicated any number of times. We 
may formally consider the varietal effects as if they were the 
result of the action of two factors at q 4 and q 2 levels respectively. 
Thus if V ij is the effect of the variety i\,- we may write 

Vn = Vu + v { . + v.j , 

2>w = Hv<i = - YjV-i = o. 


(12.2) 
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We may therefore regard the row set and the column set of 
blocks as two complete replications of a factorial design. The 
main effects of the first factor are confounded in the row set, 
the main effects of the second factor in the column set, the 
interaction remains unconfounded in both sets. Thus applying 
Theorem 11.3 with the modification appropriate to partially 
confounded arrangements discussed at the end of Chapter XI, 
we see that, because of 5.9, we have to minimize 


<3 = E E E [(DA(1, 2; a, , a,) - v aia ,] 2 

Z = 1 ai a 3 

(12.3) + g 2 E [(2)4(1; a,) - ».,.]* 

a i 

+ Qi E [(1)A(2; 0 - 2 ) ~ w -a,] , 

a a 

where the quantities (l)A( 1, 2; a, , a 2 ), (l)A( 1; a,), (l)A( 2; a 2 ) 
are computed by formula 5.5 from the 1th set of blocks. Thus 
the least square estimates 6 a , a , , , v. a , become 

0,,„, = \ E (0^(1, 2 ; > a *)> 

(12.4) 

0.,. = (2)A(1; o,), D. a , = (1)T(2; a 2 ). 

Hence 

Qa= E E E WM(1, 2; a, , a 2 ) 

Z = 1 a 1 a a 

( 12 -5) 

- 2; a, , a 2 ) + (2)A(1, 2; a, , a 2 )] 2 

and if we test the hypothesis V aia , = 0, a, = 1, • • • , <?i , 
= 1 , • • * , ?2 , 

( 12 . 6 ) Qr ~ Qa = E EC®. + E* 5 ®.' + E«-.. ' 

a\ a a Qi <*a 

The idea of a lattice may be generalized. Suppose we wish 
to test • • • g r varieties. We may then consider the varietal 
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effects as treatment combinations in a factorial experiment. 
Thus we denote the varietal effects by V a ,... a , 1 < < Qi 

and write 

r 

V ai , •••.a, — ^E ®(*1 l “ ' I *« ! ®<i > ' ‘ ' > ® 4 «)> 

a - 1 1 * * • r 

(12.7) 

y(z\ , * • • j fjt j fli ; * * * j n^) 11* 


We then form r sets of blocks. The blocks of the first set 
are formed by keeping the indices a 2 , • • • , a r fixed and allowing 
di to vary from 1 to </i . Thus q 2 • • • q, blocks are obtained. 
The blocks in the ith set are formed similarly by keeping 
Oi , • • • , , a i+1 , • • • , a r fixed and allowing a, to vary 

from 1 to q { . In the ith set all interactions which do not contain 
the ith factor are confounded giving q x • • • g,-i?,+i • • • ?r 
interaction components confounded. The remaining inter- 
action components are by Theorem 11.2 orthogonal to the 
blocks. Thus to obtain Q a we have to minimize the sum of 
the unconfounded parts of the right side of 5.9 over all the 
r sets of blocks. That is to say we have to minimize 


Q= E E 

a-1 1, 


Jh_ 




a 

• EE 


«>a 1=1 


( 12 . 8 ) 


•[(ij)A(ii f * j i a t ®ti 1 * J ®»a) 


- v(h 


) ®ii 




where (Z)A(ii , ••• , i„ ; a,-, , ••• , a,-„) is obtained by 5.5 
from the Zth set of blocks. Thus 


f(il ) * ’ ' ) i« J ®ii ) * > ®i«) 


1 “ 

— — ) 1 (tii)-A(ii j * ' * , i„ j ) * * * i 


a ,„i 


(12.9) 
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Hence 


Qa = Z Z JLi; " 9r Z • • • £ 

o-l l.'-'.r ?ij ll'i, a, x a t a 


( 12 - 10 ) T Z { (ij)A(ii , , i a ; a. 

L i = i 


- a {<)(»! , • • • , i a ; a,-, , • • • , 


If the hypothesis F 0l ... 0r = 0 , 1 .< a, < 5,. 
obtain 

, is tested we 

Q, - <2. = z z - gl " ' gr z • • 

• z« 

(i2.ri) 

•[0(*1 a.'. 

. • • • , a,.)]*. 

The degrees of freedom for Q a are 


r 

Z Z (a - 1)(?M - 1) ••• (g jo - 

a = 1 1, 

■ 1) 

because each of the (<?,-, — 1) • • • (q ia — 1) independent com- 
ponents of the interaction between the factors i, , ■ • ■ , i a 
contributes ( a — 1) squares of independent linear functions to 
Q a . The degrees of freedom for Q r — Q a are (q 1 • • • q T ) — 1. 

We proceed to compute the variances of the varietal effects 
and of differences between them. In doing this we may, without 
loss of generality, assume that F„,... a , = 0, 1 < a, < q t . 

Applying Cochran’s Theorem 2.1 to 5.7 we see that 

? £ . (Mti , ,i.;a it , 

°ti a t a 3*1 </t a 

• ■ • , a ia )) 2 

has the x 2 distribution with (q ix — 1) • • • (g la 

— 1) degrees 


of freedom. The quantities A(f, , • • • , i a ; a,, , • • • , a< J 1 < 
a *i ^ Qtj are composed from independent observations in 
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exactly the same fashion and hence must have the same variance 
Hence 



2 


= (qu -!)••• (q tm 


V- 


Thus 


(12.12) = 


(q,-. -!)••• (q„ ~ 1) 


9l • • • Qr 

Let V ai ... ar be the least square estimate of V ai ... ar then 


r 

(12.13) 7., = E Z 0(*1 > •” > «<.)• 

a = 1 1, • • • , r 

But by 12.9 the fl(t, , • • • , t, ; a., , • • • , a <a ) are sums of com- 
ponents of the interaction between the factors i y , • • • > i« 
and hence by Theorem 11.1 orthogonal to each other, more- 
over by 12.9 and 12.12 ; fl, > g.„) has the 

variance 

1 (q,, ~ 1) • • ' (g<. ~ 1) 

a q> • • • q r 

Thus 


(12.14) 


2 

Fax, •••.or 


2 yl (q., ~ 1) 


(q>. - i) 


To obtain the variance of the difference between two factors 
we first compute the covariance between A{i x , ••• , i a ; 
a it , ■ ■ • , a *J and >'“>*•> *»+i > ' " > > a ii > " ' y a <- > 

6,. +1 , ■■■ , &,-.) where a it ^ b it . We first compute the co- 
efficient of x Cl ... Cr in A(ii , *• • , t« ; , • • • , a >J- Suppose 

that c*, -— a*, , * j c,,' — — q,,- j c, ^ q*,+i j > ^ ^ ,a * 

Then x Cl ... Cr occurs in 5.5 only in terms for which fci • • • kp 
are chosen from i y , • • • , f, . The coefficient of x Cl ... Cr in 
x(fc t , • • • , fc/j ; c tl , • • • , c t p) is (q*, , • • • , qk$)/ (Q i > ' ' ' » ?>■)• 
Hence the coefficient of x Cl ... Cr in A(i y , ■ ■ ■ , i a ; q>, , • • • , 
a,„) becomes 
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2£(-i)“ H * y " qkt 

9l Qr 


P-o 


(12.15) 


(~ 1) Y' V~> / -,\i-P 

// • • • n Er ) 9*i > 

9i Vr p-o i,, •••,,•, 


?* 9 


= (-1)“-’ 
Ql ■■■ Qr 

From 5.4 we then have 


-!)••• ~ 1). 


(12.16) 


= E E A(t x 


; Ci, 


i Ctu) • 


We multiply 12.16 by A(t, o 4l f , a, J and take 

expectations on both sides. The left side then becomes 


(-I)" - ’ 

9l ■ • • Qr 


(9<i -!)••• (9*i - l) ff2 


On the right side we obtain the covariance a[A (i t 

i * * ' > ®*a)^f(fi j * j f a j c 4l f ‘ ' f CiJ] of .4 (z\- j • * * , i a ) 
°<« > " ’ ' i a *J an d Afo , • • • , ; Ci, , • • • , c,J since inter- 
actions between different factors are by Theorem 11.1 orthog- 
onal and therefore independent. Thus 


<r[A(ii , • • • , i,i, +l , * • • , i’er J Oti, f ... ^ +1 , 

' A(fj , * ) + 1 j * > fa i flii > * ■ * J j 

(12.17) 


> a. J 
, &,.)] 


(-D — 

9l ■■■ 9r 


( 9» p i -!)••• (9,-. - iy 


for 5 ^ a it . 


We therefore have 


o’ [4(f x , • • • , *„ , o,i l , • • • , fl>„) A(ii , • • • , i, , z’ J+1 , 

, z„ , a*, , • • • , fli. , 5, t+1 > • • • , 6<„)] 

(12-18) 

= gi . . . gf Kft, -!)••• (9<a - 1) + (-1)“- +1 
■(9u -!)••• (9i. - l)]<r 2 
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Thus 

17 ^Ot,"- t fl,,i,+ i 1 "*, 6 r ) 



e e (?i, (?,„ - 1) 


(12.19) 


r — a 


• E 


E 


i 


[(?*. - I)" - (<?*, ~ 1) + (-l)"* 1 ]. 


In the case of a two dimensional lattice 12.19 reduces to 
2 ~j~ <?1 d~ <?2 


?1?2 

2 glg 2 + 92 
?1?2 

In a three dimensional lattice 


» r 6 k, j 9* l, 
i = k, j 9 * l. 


a Viik-V i.„ — 


2 2gig 2 g 3 + gig 2 + g 2 ff 3 + gtga + 2(gi + g 2 + g 3 ) 

3?i? 2 g 3 ’ 

t 5^ l, j 9* m, k 7* n, 

a 2 2gig 2 g 3 + gig 2 + gigs + q 2 q 3 + 2(g 2 + q 3 ) 

3gig 2 g 3 ’ 

i = l, j 9^ m, k 9^ n, 


2 2q t q 2 q 3 + gig 3 + g 2 g 3 + 2g 3 

3gi? 2 ?3 


i = l, j = m, k 9* n. 


The calculation of the efficiency factors with respect to the 
varietal estimates and differences between them is left to the 
reader. 

If the number of varieties is the square of a power of a 
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prime, then the experiment may be laid out to advantage in 
a so called lattice square, which like a Latin square permits us 
to break the soil fertility into two rectangular components. 
In a lattice square to 2 varieties are replicated in r square arrays 
each with to 2 plots in such a way that every pair of varieties 
occurs together in the same row or the same column the same 
number X of times. To construct a lattice square one needs 
(to — 1) orthogonal squares. The individual boxes of these 
squares may be denoted by v x , • • • , v m > . Together with the 
row and column number of the Latin square each box corre- 
sponds to (to + 1) numbers i x , ■ ■ ■ , i m+1 0 < i k < to — 1 
and the to 2 vectors v a = (i [ a) , ■ • • , il?+ 1 ), a = 1, • • • , to 2 
have the property that for every 0 < p, t < m — 1 and each 
pair t, s there is exactly one vector v a for which ^ 1 < “ , = p, 

„•<“> _ 
l» = T. 

We now form the first square by ordering the varieties into 
a square according to the first pair of coordinates. That is to 
say if v a = (*1“’, ig* 1 , • • ■) then v a is placed into the qst row 
and the * 2 nd column. The second square is similarly arranged 
according to i 3 , u and so forth. If to is odd we obtain in this 
manner (to + l)/2 replications. Since the rows and the columns 
of the squares are the lines of a finite Euclidean plane whose 
points are the varieties, it follows that every pair of varieties 
occurs just once together either in a row or in a column. If 
to is even we arrange according to the indices (i 1 , * 2 ), (L , z 4 ), 
• • • , (i m _! , i m ), (i m+1 , it), • • • , (i m , i m+i ). Thus every line of 
the corresponding Euclidean Geometry occurs twice, once as a 
row and once as a column, and therefore every pair of varieties 
will appear together twice, once in the same row and once in 
the same column. We shall exemplify the procedure by con- 
structing a lattice square for 9 and for 4 varieties. We start 
from 2 orthogonal 3 sided Latin squares 


1„1 

2„„2 

3„,3 

2..3 

3..1 

1..2 

3„2 

1..3 

2..1 


The two squares of the lattice square then are 
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Vi 

v 2 

V 3 


Vi 

Vq V s 

t-H 

II 

rf*. 

v 3 

V 3 

L 2 = 

-- v 3 

Vi Vi 

V 7 

Vs 

V 3 


V 3 

v 7 v 3 

Similarly from 






• 

1 

Vi 

2 

Vi 



2 

V 3 

1 

Vi . 


We obtain 3 squares 

of a lattice 

square 

with 4 varieties 

»i v 2 


Vi 

Vi 


Vi 

Li = 


L 2 = 



l 3 = 

V 3 t> 4 


v 3 

v 3 


Vi 


The assumptions underlying the lattice square are 


( 12 . 20 ) 


y\V = ri“> + cj a) + + m'“’ + /x + , 

Z r'“> = Z c } -> = Z M ta> = Z v k = 0, 


where 


2 /J, a) is the observed yield in the ith row and jth column of the 
ath replication. 

r' a> is the effect of the ith row in the ath replication. 
c\ a) is the effect of the jth column in the ath replication. 
v k * u is the effect of the variety in the ith row and jth column 
of the ath replication. 
m <q0 is the effect of the ath replication. 
ji is the general mean. 

The e,-“ ) are normally and independently distributed random 
variables with mean 0 and the same but unknown variance a 2 . 
The equations resulting from minimizing 


Q = Z Z Z ivW - - c' 0) - - M “ - m ) 2 
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become, if the Lagrange operator is ignored, 

m = E Z Z Vi? = y, 


rm 


a t j 


HI i J 

(12.21) E j/i"' = E + E c, u> + rfl* + r£, 


myW = mi 5 !"’ + E ^/ + mn fa) + mu, 

r.(«) 

mi/i" 1 = mCj a) + E A# + w/n <a) + mu, 

c i < « > 


where E>* denotes summation over all plots containing the 
fcth variety, E^<“> (E. .(■»)) denotes summation over all plots 
contained in the ith row, (or column), of the ath replication. 

Summing the fourth and fifth equations over all rows and 
columns respectively which contain the fcth variety we obtain 

m[E (vP - y) + E (y-f - v)] 

Vk Vk 

( 12 . 22 ) 

= m E + ro E ^ a> + (2r - X>* . 


Dividing 12.22 by m and subtracting from 12.21 yields on 
account of r = (m + l)/2 X 


(12.23) 0* = 


. X(m — 1) 


E (yir - vP - y\V + y ). 


Hence 


(12.24) 


E’ = vSr* - y ia) - ^Efi,-, 


m ,rr:> 


= 2/E ~ 2/ <a> - ^E««. 

771 c j- ( o ) 
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If f? <a> , cf < “ > are the least square estimates of r\ a \ c\ a) 
under the hypothesis v f = 0, j = (1, • • • , m 2 ) then 


(12.25) 


= y s?’ - y (a> , 

cf ( “> = 2/!,“’ - 2/ <a> - 


It is easily verified that these solutions satisfy the restrictions 
in 12.20. Hence by Theorem 4.2 


(12.26) 


Qa = E E E G/u’) 2 

a i i 

- m Z [£ (y^) 2 + E (2/!“>) 2 ] 

ax i 

r < cj 

+ m 2 E (j/ <a, ) 2 > 

a 

Q,-Q.= T, E Z) (*»■■! - m S'" 


We shall now compute the variance of D* . We shall simply 
compute the coefficients of the observations entering into 0* . 
There are r observations on the fcth variety which enter into 
0* with the coefficient [2 (m - l)]/(Xm 2 ). Further 2r(m - 1) 
varieties different from each of which occurs either in a row 
or in a column together with v k which enter into v k with the 
coefficient — 2 /(Km 2 ) and r(m - l) 2 observations not together 
with the fcth variety in a row or column and therefore entering 
with the coefficient 2/[Xm 2 (m — 1)]. Thus 


o-L 4r(m — l) 2 , 2 r(m — 1) *4 4r 
a 2 ~ X 2 m 4 + X 2 m 4 ^ X 2 m 4 


4 rm 2 4r 2(m + 1) 

" XW “ X 2 m 2 “ Xm 2 
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Since every pair of varieties occurs exactly X times Q r — Q„ 
must be symmetric in the 0* . Therefore applying Theorem 4.5, 
12.26 simplifies to 

Q. = Z Z Z (yltr - m z [£ (y^r 

a i t a i 

(12.27) + £ (2/!, a> ) 2 ] - (r - X) £ A* + m 2 £ (y'°y 

* k a 

Qr ~ Qa = (r - X) X) • 

* 

The degrees of freedom of are m 2 r — (m 2 — 1) — 
2r(m - 1) - (r - 1) - 1 and of Q r - Q a , m 2 - 1. 

The variance of 0 ( — 6,- can also be obtained by simple 
enumeration of the observations entering into <5, — 0, and 
turns out to be 

ff («i -«j) 2 

<j r — X 

The details of this enumeration are left to the reader. 

The efficiency factors with respect to f),- and with respect to 
fh — f), both turn out to be (m — 1 )/(m + 1). 

Several more complicated designs are in use which all evaluate 
the idea of treating the varietal effects as treatment com- 
binations of several factors. It is for instance always possible 
to superimpose a Latin square on a square lattice and then 
to introduce a third set of blocks by grouping the varieties 
according to the letters of a Latin square. Such arrangements 
are called triple lattices. Similarly with a set of r orthogonal 
squares it is possible to obtain an (r + 2) fold lattice. If 
r = (p — 1) where p is the length of the side then the resulting 
design is termed a balanced lattice. The designs discussed in 
this chapter were invented by F. Yates and proposed by him 
in several important publications. (Journal of Agr. Science 26, 
pp. 424-455, Ann. Eugenics, pp. 319-332, Journal of Agri- 
cultural Science 30, pp. 672-728.) 


CHAPTER XIII 


Analysis of Covariance 


We shall consider in this chapter the following linear 
hypothesis. Suppose we have N observations y x , y 2 , • • • , y N 
and constants x la , • ■ ■ , x va (a = !,•••, N). We assume 


E(y«) = Ha + PlXla + • • • + PvXpa « = 1 , • ■ • , N, 

(13.1) 


22 \iyfiy =0 i = 1, • • • , s < N rank (X, T ) = s > p. 

7 


The hypotheses to be tested may concern either the p a or 
the /?,- . Accordingly we shall consider two kinds of hypotheses 


(13.2) 


H ! : 22 = 0, i = s + 1, • ■ • , r < N, 

7 

rank (X <Y ) = r, 


H 2 : 22 v nPi = 0," i = 1, • • • , p. 


Both hypotheses are linear hypotheses and Theorem 4.1 
applies. The degrees of freedom for Q a are obtained as follows: 
The expectations E{y a ), a = 1, • • • , N, are first expressed by 
the N + p parameters p a , a = 1, • • • , N; /3< , i — 1, • • • , p. 
The linear restrictions in 13.1 enable us to eliminate s of the 
/i„ . If we arrange it so that pi , • • • , n, are eliminated this 
will lead to 

N 

(13.3) E(y a ) = 22 «iaMi + /3iXi« + ■ • • + PpXpa . 

;-« + ! 


If the matrix 


(13.4) 


/ ' 

®U + m ’ ‘ ■ Givi ’ ' ' £j>i 


+ ■ • ■ &NN %IN ' ' ■ XpN, 
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has the rank N + p — s then we have expressed the N ex- 
pectations E(y a ) by N + p — s parameters and this is equiva- 
lent to s — p linear restrictions on E(y a ). Thus Q a will have 
s — p degrees of freedom if the matrix 13.4 has the rank N + 
p — s. The degrees of freedom for Q r - Q a are obtained by a 
straight forward application of Theorem 4.1. 

The analysis of covariance is frequently applied to r way 
classification designs. Thus we might have taken observations 
on the weight gains of animals from r different races at fc 
different diets and might have recorded the initial weight of 
each animal. Assuming that the interaction is 0 and that 
weight gains of animals depend linearly on the initial weight 
we can write our assumptions as 

E{ya) = po + p.j + p + fan i = 1, • • • , r;j = 1, • . . , k, 

where y u is the weight gain of the animal from the ith race 
receiving the jth diet and x u is the initial weight of this animal. 
The hypotheses to be tested may be 

Hi : Pi. = 0, i = 1 , • • • , r,; H 2 '. p-i = 0, j = 1 , • • • , k; 

H 3 : j8 = 0. 

The tests for these hypotheses are obtained by a straight 
forward application of Theorem 4.1*. 


CHAPTER XIV 


Interblock Estimates and Interblock Variance 

The block which will contain a certain set of treatment 
combinations or varieties is actually always chosen at random 
so that the block effect may also be regarded as a random 
variable. This point of view makes it possible to obtain un- 
biased and consistent estimates also of confounded interactions 
in a factorial experiment. Thus from formula 11.13 we see 
that if L a presents the linear form X0 tagXg corresponding to 
the linear form S a — Xu t a gTg in the treatment combinations 
Tg then 

(14.1) L a = S a + X tccgbig + X W 0 ) 

0 0 

where the eg are normally and independently distributed with 
mean 0 and variance a 2 . If the block effects are considered as 
normally distributed random variables independent of each 
other and of the random error e a with variance a ' 2 and mean 
y, then L a is an unbiased estimate of S a if S a is not the mean 
and thus comparisons between confounded linear functions are 
still possible. The variance of a confounded form L a becomes 
by 11.14 u V 2 X> c 2 ai i + a X/» • Now u X; c« ,• = 1, X„ = 1 

because of the orthogonality of the substitution. Hence 

(14.2) crl „ = ua ' 2 + a 2 . 

If Lg is another confounded linear form then a LaL „ = 
mV 2 X> c af Cgj + it 2 Xy taytg y = 0 because of the orthog- 
onality of the matrix ( t a g ) and the assumption of independence 
of the block effects. Similarly u LaL g = 0 if L a is confounded 
and Lg unconfounded. Thus comparisons involving con- 
founded linear functions become possible. The estimates of 
L a obtained in this way are called interblock estimates and 
the comparisons between interblock estimates are termed in- 
terblock comparisons. The variance ua ' 2 + c 2 can be estimated 
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if several complete replications are available. The confounded 
forms are then treated as a separate set of observations all 
with the same variance and with means S a . As long as no 
partial confounding takes place confounded linear forms may- 
be compared with each other applying the F test, with Q a 
being obtained from the sum of the squares of deviations of 
these forms from their mean values. The degrees of freedom 
of Q a are (r — 1)/ where r is the number of replications and / 
the number of linear forms confounded. For comparisons of 
confounded with unconfounded forms no exact test is available 
at present. 

If the linear form S a in the treatment combinations is 
confounded in some replications and orthogonal to the blocks 
in other replications, we shall obtain two independent estimates 
of S a : intrablock estimates from those replications where 
S a is orthogonal to the blocks and interblock estimates from 
replications in which S a is confounded with all the blocks. 
If we would know the interblock and the intrablock variance 
then these two estimates could be combined so as to yield 
mi n i m um variance. Let L a and L' a be the intrablock and the 
interblock estimate respectively of S a and let and o' a be 
the variances of L a and L' a respectively. L a and L' a are in- 
dependent being derived from different observations and both 
are also independent of Q a as may be seen from Theorem 11.3. 
An easy calculation shows that 

olL^tolL^ 

-L'a ” /2 I 2 

O’ a -h O a 


has the smallest variance among all linear combinations of 
the form (oL a + 6L')/(a + b). Moreover L* is normally 
distributed with variance (ffiV a )/((r« + o 2 a ) so that 


(14.3) 


p f ^ + oj Lf 
" 1 ff'.V. Qa/cr 2 • 


has the F distribution with 1 and / degrees of freedom where 
/ is the number of degrees of freedom for Q a as giveh by Theorem 
11.3 and c 2 a is some known multiple of a 2 . However <r 2 and 
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a' 2 are not accurately known. As_ an estimate of a 2 we may 
use Qjf and an estimate of ua' 2 + a 2 may be obtained from 
those linear forms which are confounded in more than one 
replication and also by comparing the observations on the 
same linear form in replications where it is confounded with 
those in replications where it is unconfounded. However, if we 
replace a 2 and a' 2 by these estimates then F as given by 14.3 
does not have the F distribution. If the estimates a 2 and a' 2 
are both based on a large number of degrees of freedom then 
F in 14.3 will at least be approximately distributed as F since 
a 2 and a' 2 converge stochastically to their true values. Thus 
although we might gain somewhat in efficiency by utilizing 
the interblock estimates we do so at the expense of mathe- 
matical rigor. It may also be remembered that a decrease in 
variance is not necessarily equivalent to an increase in power. 
Formula 14.2 shows moreover that the variance of the inter- 
block estimates is large compared to the variance of the intra- 
block estimates, whenever there is any appreciable variation 
from block to block. Thus a sizeable advantage is derived from 
the use of the interblock estimates only if the blocks are nearly 
uniform in fertility. 

In quasifactorial designs the procedure described in the pre- 
ceding paragraph applies without change. In other designs for 
varietal trials, for instance incomplete balanced blocks, the 
application is not immediate. We note however that the sums 
of the yields of whole blocks involve differences in the varietal 
content of the blocks. Thus estimates of the varietal effects 
may be obtained by considering the regression of the block 
totals on the varietal effects. The estimates of the varietal 
effects obtained in this manner will be linear functions of the 
block totals. We shall show that the block totals are inde- 
pendent of the intrablock estimates and independent of Q„ . 
We refer to the assumptions 7.8 of a general arrangement of 
varieties in blocks where however no variety occurs more than 
once in any block. The estimate f), is consistent by 4.49. Hence 
if Oi = X) where x x , • • • , x N are the observations then 
= t>, + S + m L , where x a lies in the ith 
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block. Since is an unbiased estimate of we must have 
Z*«<=k K = Z*«c&f for a H * and j and Z« X<* = 0. Hence 
Zi.cn X„ = 0 which means that fh is orthogonal to, and 
therefore independent of the block sums. 

If in the set up 7.8 we test the hypothesis v { = 0 then the 
estimates of the block effects will be given by the block averages. 
Applying Theorem 4.2 and 4.1 we then see that the block 
sums are also independent of Q„ obtained by minimizing 7.9. 
Since the interblock estimates are linear functions of the block 
sums it follows that they are independent of the intrablock 
estimates and of Q a computed from the intrablock estimates. 
Interblock and intrablock estimates may be combined as in 
factorial experiments so as to give minimum variance. For this 
process it is necessary to estimate the interblock variance. To 
obtain such an estimate it will be convenient to write the 
assumptions 7.8 in the form 

(14.4) E{y it ) = v { + 6,- Z v < = 0. 

t 

We shall also assume that no variety occurs twice in the same 
block. 

If we test the hypothesis f>, = y, j = 1, • • • , b then the re- 
gression value of y u becomes F</r, and hence by Theorem 4.2 

(14.5) Qr - Qa= Z Vu - E (J lu - 6< - b,) 2 - zf 

• i 

Since 14.5 is the proper statistic for testing the hypothesis 
bj = y it must have ( b — 1) degrees of freedom where b is 
the number of blocks. Moreover it can not depend on the . 
Thus 

Q r - Q a = EE OoM, + Z a t b, + W. 

i l t 

Where W is independent of the and v< . The a,/ are, more- 
over, constants and the a, independent of b t . 

If the bi are all equal to n then Z* Z# «. Ah, + Z> ®A = 
M 2 Zi Z i a u + M Z> naust be independent of j u and there- 
fore Z. Z i a u = Z. a. = 0 and E(W) = (b — l)a 2 . Then 
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if the bj are considered as random variables with the expectation 
£(£ £ a tl b t b t + £ a t b ( ) 

* i i 

= a' 2 £ a u + m 2 £ £ an + ju£ a; 



Thus the expectation of Q r — Q„ when the 6, are considered 
as independent random variables must be of the form aa' 2 + 
( b — l)a 2 . To find a we have to find the sum of the coefficients 
of the b 2 appearing in 14.5. 

The middle term in 14.5 is an estimate of a multiple of a 2 
and therefore independent of 6, . In the first term b 2 occurs 
with the coefficient k, , in the last term with the coefficient 
£ < ' ) 1 /r ( where £ (,) f(t) denotes the summation of f(i) over 
all i such that the zth variety occurs in the jth block. Hence 

E(Qr - Qa) = (n - £ £ <n -V' 2 + (5 - 1)<7 2 
(14.6) v ' (/ 

= (N - v)a ' 2 + (b - l)c 2 , 

where N is the number of experiments and v the number of 
varieties. Since Q a has N — v — b -f 1 degrees of freedom 


Qr Qa 


b - 1 


N — v — 6 + 1 


Qa — Qr 


N — v 


N -v - b+1 


Qa 


may be used as an estimate of (N — v)a' 2 . 

We shall apply these results to incomplete balanced block 
designs. The interblock variance <r| of the block totals becomes 

<x 2 b = k 2 a ' 2 + k<r 2 . 

To estimate <r 2 B we use 


M = £ »!, - £ ( Vii -<)<- bj + ^) 2 - i £ F 2 , 
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where , S, , m are given by 7.19. From 14.6 we have 
(14.7) E(M) = v(r - 1 )<r' 2 + (6 - l)<r 2 . 

Thus putting 

Qa _ C 2 

bk - v - b + 1 


(».s) ^ - i . 

Thus fc [&M — (v — /c)s 2 ]/[«(r — 1)] may be used as an 
estimate of <t 2 b . The intrablock estimate of u,- is = 
(kVi — Ti)/(\v). The interblock estimate is found by mini- 
mizing 

(14.9) Q' = £ (B, - Z"’ - M 2 

i 

under the restriction = 0- Differentiation with respect 

to v, and n yields 

fc?V + (r — X)f5( = Ti + t, i = 1, — , v, 


(14.10) 



= M- 


where r is the Lagrange operator and v'i , p! the interblock 
estimates of v < , p. Adding the first of the equations 14.10 over 
the varieties yields t = 0 and hence 


(14.11) 


= 


Tj — krp 
r — X 


We shall usually want maximum precision with respect to 
the estimates of varietal differences. Now 


(14.12) 


2 

Oii-ii 



2<r 2 „ 

(r - X) 2 


2 

(r - X) 




(r — X) = 


2 

<T B • 
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Thus maximum precision for the varietal differences is 
obtained if we use as their estimates the differences of the 
quantities 

* _ <Tfl/(r — X)fl,- + (fccrMXtW 
<r\/{r — X) + (k<r 2 )/(\v) 

(14.13) 

_ + k(r — \)g 2 0' 

\va\ + k(r — \) a 2 

The variance of the difference v* — v* is given by 

2 _ 2ka 2 

’ ‘ ’ 1 g 2 k(r — X) + \vo 2 b 

Thus 

bk-v-b+1 a 2 k(r - X) + \vc\ (vf - vf) 2 
1 2ka 2 B Q a 

has the F distribution with 1 and bk — v — b + 1 degrees of 
freedom respectively. Actually however a 2 and <r| are not 
accurately known and must be replaced by QJ (bk — v — b + 1) 
and 

, kM - (v - k)S 2 „ 2 
k = ' Sb - 

This will not lead to a very serious inaccuracy if the number 
of blocks is sufficiently large. However an advantage is only 
gained if the soil fertility differences between the blocks is 
actually very small. Sometimes it may happen that the estimate 
for o-| becomes smaller than S 2 . In this case it is recommended 
to replace it by S 2 in formula 14.13 since a\ > a 2 under all 
circumstances and since S 2 is a better estimate of a 2 than Si 
even if there are no block differences. 

The procedure for utilizing interblock estimates in the 
analysis of incomplete balanced block designs which we derived 
above is arranged for easy calculation in the 1943 edition of 
the statistical Tables of Fisher and Yates. 
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TABLE 10.7 — 5% ( Roman Type ) and 1% ( Bold 


m degrees of freedom for numerator 


n* 



1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

1 

161 

4,052 

200 

4,999 

216 

5,403 

225 

5,625 

230 

5,764 

234 

5,859 

237 

5,928 

239 

5,981 

241 

6,022 

242 

6,056 

243 

6,082 

244 

6,106 

2 

18.51 

98.49 

19.00 

99.00 

19.16 

99.17 

19.25 

99.25 

19.30 

99.30 

19.33 

99.33 

19.36 

99.34 

19.37 

99.36 

19.38 

99.38 

19.39 

99.40 

19.40 

99.41 

19.41 

99.42 

3 

10.13 

34.12 

9.55 

30.82 

9.28 

29.46 

9.12 

28.71 

9.01 

28.24 

8.94 

27.91 

8.88 

27.67 

8.84 

27.49 

8.81 

27.34 

8.78 

27.23 

8.76 

27.13 

8.74 

27.05 

4 

7.71 

21.20 

6.94 

18.00 

6.59 

16.69 

6.39 

15.98 

6.26 

15.52 

6.16 

15.21 

6.09 

14.98 

6.04 

14.80 

6.00 

14.66 

5.96 

14.54 

5.93 

14.45 

5.91 

14.37 

5 

6.61 

16.26 

5.79 

13.27 

5.41 

12.06 

5.19 

11.39 

5.05 

10.97 

4.95 

10.67 

4.88 

10.45 

4.82 

10.27 

4.78 

10.15 

4.74 

10.05 

4.70 

9.96 

4.68 

9.89 

6 

5.99 

13.74 

5.14 

10.92 

4.76 

9.78 

4.53 

9.15 

4.39 

8.75 

4.28 

8.47 

4.21 

8.26 

4.15 

8.10 

4.10 

7.98 

4.06 

7.87 

4.03 

7.79 

4.00 

7.72 

7 

5.59 

12.25 

4.74 

9.55 

4.35 

8.45 

4.12 

7.85 

3.97 

7.46 

3.87 

7.19 

3.79 

7.00 

3.73 

6.84 

3.68 

6.71 

3.63 

6.62 

3.60 

6.54 

3.57 

6.47 

8 

5.32 

11.26 

4.46 

8.65 

4.07 

7.59 

3.84 

7.01 

3.69 

6.63 

3.58 

6.37 

3.50 

6.19 

3.44 

6.03 

3.39 

5.91 

3.34 

5.82 

3.31 

5.74 

3.28 

5.67 

9 

5.12 

10.56 

4.26 

8.02 

3.86 

6.99 

3.63 

6.42 

3.48 

6.06 

3.37 

5.80 

3.29 

5.62 

3.23 

5.47 

3.18 

5.35 

3.13 

5.26 

3.10 

5.18 

3.07 

5.11 

10 

4.96 

10.04 

4.10 

7.56 

3.71 

6.55 

3.48 

5.99 

3.33 

5.64 

3.22 

5.39 

3.14 

5.21 

3.07 

5.06 

3.02 

4.95 

2.97 

4.85 

2.94 

4.78 

2.91 

4.71 

11 

4.84 

9.65 

3.98 

7.20 

3.59 

6.22 

3.36 

5.67 

3.20 

5.32 

3.09 

5.07 

3.01 

4.88 

2.95 

4.74 

2.90 

4.63 

2.86 

4.54 

2.82 

4.46 

2.79 

4.40 

12 

4.75 

9.33 

3.88 

6.93 

3.49 

5.95 

3.26 

5.41 

3.11 

5.06 

3.00 

4.82 

2.92 

4.65 

2.85 

4.50 

2.80 

4.39 

2.76 

4.30 

2.72 

4.22 

2.69 

4.16 

13 

4.67 

9.07 

3.80 

6.70 

3.41 

5.74 

3.18 

5.20 

3.02 

4.86 

2.92 

4.62 

2.84 

4.44 

2.77 

4.30 

2.72 

4.19 

2.67 

4.10 

2.63 

4.02 

2.60 

3.96 

14 

4.60 

8.86 

3.74 

6.51 

3.34 

5.56 

3.11 

5.03 

2.96 

4.69 

2.85 

4.46 

2.77 

4.28 

2.70 

4.14 

2.65 

4.03 

2.60 

3.94 

2.56 

3.86 

2.53 

3.80 

15 

4.54 

8.68 

3.68 

6.36 

3.29 

5.42 

3.06 

4.89 

2.90 

4.56 

2.79 

4.32 

2.70 

4.14 

2.64 

4.00 

2.59 

3.89 

2.55 

3.80 

2.51 

3.73 

2.48 

3.67 

16 

4.49 

8.53 

3.63 

6.23 

3.24 

5.29 

3.01 

4.77 

2.85 

4.44 

2.74 

4.20 

2.66 

4.03 

2.59 

3.89 

2.54 

3.78 

2.49 

3.69 

2.45 

3.61 

2.42 

3.55 

17 

4.45 

8.40 

3.59 

6.11 

3.20 

5.18 

2.96 

4.67 

2.81 

4.34 

2.70 

4.10 

2.62 

3.93 

2.55 

3.79 

2.50 

3.68 

2.45 

3.59 

2.41 

3.52 

2.38 

3.45 

18 

4.41 

8.28 

3.55 

6.01 

3.16 

5.09 

2.93 

4.58 

2.77 

4.25 

2.66 

4.01 

2.58 

3.85 

2.51 

3.71 

2.46 

3.60 

2.41 

3.51 

2.37 

3.44 

2.34 

3.37 

19 

4.38 

8.18 

3.52 

5.93 

3.13 

5.01 

2.90 

4.50 

2.74 

4.17 

2.63 

3.94 

2.55 

3.77 

2.48 

3.63 

2.43 

3.52 

2.38 

3.43 

2.34 

3.36 

2.31 

3.30 

20 

4.35 

8.10 

3.49 

5.85 

3.10 

4.94 

2.87 

4.43 

2.71 

4.10 

2.60 

3.87 

2.52 

3.71 

2.45 

3.56 

2.40 

3.45 

2.35 

3.37 

2.31 

3.30 

2.28 

3.23 

21 

4.32 

8.02 

3.47 

5.78 

3.07 

4.87 

2.84 

4.37 

2.68 

4.04 

2.57 

3.81 

2.49 

3.65 

2.42 

3.51 

2.37 

3.40 

2.32 

3.31 

2.28 

3.24 

2.25 

3.17 

22 

4.30 

7.94 

3.44 

5.72 

3.05 

4.82 

2.82 

4.31 

2.66 

3.99 

2.55 

3.76 

2.47 

3.59 

2.40 

3.45 

2.35 

3.35 

2.30 

3.26 

2.26 

3.18 

2.23 

3.12 


The function, F = e with exponent 2 z, is computed in part from Fisher’s table 


Face Type) Points for the Distribution of F 
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14 

16 

20 

24 

30 

40 

50 

75 

100 

200 

500 

00 


245 

246 

248 

249 

250 

251 

252 

253 

253 

254 

254 

254 

1 

6,142 6,169 6,208 6,234 6,258 6,286 6,302 6,323 6,334 6,352 6,361 6,36b 


19.42 19.43 19.44 19.45 19.46 19.47 19.47 19.48 19.49 19.49 19.50 19.50 

2 

99.43 99.44 99.45 99.46 99.47 99.48 99.48 99.49 99.49 99.49 99.50 99.50 


8.71 

8.69 

8.66 

8.64 

8.62 

8.60 

8.58 

8.57 

8.56 

8.54 

8.54 

8.53 

3 

26.92 

26.83 26.69 26.60 26.50 26.41 26.35 

26.27 26.23 26.18 26.14 26.12 


5.87 

5.84 

5.80 

5.77 

5.74 

5.71 

5.70 

5.68 

5.66 

5.65 

5.64 

5.63 

4 

14.24 

14.15 

14.02 

13.93 

13.83 

13.74 

13.69 

13.61 

13.57 13.52 13.48 

13.46 


4.64 

4.60 

4.56 

4.53 

4.50 

4.46 

4.44 

4.42 

4.40 

4.38 

4.37 

4.36 

5 

9.77 

9.68 

9.55 

9.47 

9.38 

9.29 

9.24 

9.17 

9.13 

9.07 

9.04 

9.02 


3.96 

3.92 

3.87 

3.84 

3.81 

3.77 

3.75 

3.72 

3.71 

3.69 

3.68 

3.67 

6 

7.60 

7.52 

7.39 

7.31 

7.23 

7.14 

7.09 

7.02 

6.99 

6.94 

6.90 

6.88 


3.52 

3.49 

3.44 

3.41 

3.38 

3.34 

3.32 

3.29 

3.28 

3.25 

3.24 

3.23 

7 

6.35 

6.27 

6.15 

6.07 

5.98 

5.90 

5.85 

5.78 

5.75 

5.70 

5.67 

5.65 


3.23 

3.20 

3.15 

3.12 

3.08 

3.05 

3.03 

3.00 

2.98 

2.96 

2.94 

2.93 

8 

5.56 

5.48 

5.36 

5.28 

5.20 

5.11 

5.06 

5.00 

4.96 

4.91 

4.88 

4.86 


3.02 

2.98 

2.93 

2.90 

2.86 

2.82 

2.80 

2.77 

2.76 

2.73 

2.72 

2.71 

9 

5.00 

4.92 

4.80 

4.73 

4.64 

4.56 

4.51 

4.45 

4.41 

4.36 

4.33 

4.31 


2.86 

2.82 

2.77 

2.74 

2.70 

2.67 

2.64 

2.61 

2.59 

2.56 

2.55 

2.54 

10 

4.60 

4.52 

4.41 

4.33 

4.25 

4.17 

4.12 

4.05 

4.01 

3.96 

3.93 

3.91 


2.74 

2.70 

2.65 

2.61 

2.57 

2.53 

2.50 

2.47 

2.45 

2.42 

2.41 

2.40 

11 

4.29 

4.21 

4.10 

4.02 

3.94 

3.86 

3.80 

3.74 

3.70 

3.66 

3.62 

3.60 


2.64 

2.60 

2.54 

2.50 

2.46 

2.42 

2.40 

2.36 

2.35 

2.32 

2.31 

2.30 

12 

4.05 

3.98 

3.86 

3.78 

3.70 

3.61 

3.56 

3.49 

3.46 

3.41 

3.38 

3.36 


2.55 

2.51 

2.46 

2.42 

2.38 

2.34 

2.32 

2.28 

2.26 

2.24 

2.22 

2.21 

13 

3.85 

3.78 

3.67 

3.59 

3.51 

3.42 

3.37 

3.30 

3.27 

3.21 

3.18 

3.16 


2.48 

2.44 

2.39 

2.35 

2.31 

2.27 

2.24 

2.21 

2.19 

2.16 

2.14 

2.13 

14 

3.70 

3.62 

3.51 

3.43 

3.34 

3.26 

3.21 

3.14 

3.11 

3.06 

3.02 

3.00 


2.43 

2.39 

2.33 

2.29 

2.25 

2.21 

2.18 

2.15 

2.12 

2.10 

2.08 

2.07 

15 

3.56 

3.48 

3.36 

3.29 

3.20 

3.12 

3.07 

3.00 

2.97 

2.92 

2.89 

2.87 


2.37 

2.33 

2.28 

2.24 

2.20 

2.16 

2.13 

2.09 

2.07 

2.04 

2.02 

2.01 

16 

3.45 

3.37 

3.25 

3.18 

3.10 

3.01 

2.96 

2.89 

2.86 

2.80 

2.77 

2.75 


2.33 

2.29 

2.23 

2.19 

2.15 

2.11 

2.08 

2.04 

2.02 

1.99 

1.97 

1.96 

17 

3.35 

3.27 

3.16 

3.08 

3.00 

2.92 

2.86 

2.79 

2.76 

2.70 

2.67 

2.65 


2.29 

2.25 

2.19 

2.15 

2.11 

2.07 

2.04 

2.00 

1.98 

1.95 

1.93 

1.92 

18 

3.27 

3.19 

3.07 

3.00 

2.91 

2.83 

2.78 

2.71 

2.68 

2.62 

2.59 

2.57 


2.26 

2.21 

2.15 

2.11 

2.07 

2.02 

2.00 

1.96 

1.94 

1.91 

1.90 

1.88 

19 

3.19 

3.12 

3.00 

2.92 

2.84 

2.76 

2.70 

2.63 

2.60 

2.54 

2.51 

2.49 


2.23 

2.18 

2.12 

2.08 

2.04 

1.99 

1.96 

1.92 

1*90 

1.87 

1.85 

1.84 

20 

3.13 

3.05 

2.94 

2.86 

2.77 

2.69 

2.63 

2.56 

2.53 

2.47 

2.44 

2.42 


2.20 

2.15 

2.09 

2.05 

2.00 

1.96 

1.93 

1.89 

1.87 

1.84 

1.82 

1.81 

21 

3.07 

2.99 

2.88 

2.80 

2.72 

2.63 

2.58 

2.51 

2.47 

2.42 

2.38 

2.36 


2.18 

2.13 

2.07 

2.03 

1.98 

1.93 

1.91 

1.87 

1.84 

1.81 

1.80 

1.78 

22 

3.02 

2.94 

2.83 

2.75 

2.67 

2.58 

2.53 

2.46 

2.42 

2.37 

2.33 

2.31 



VI (7). Additional entries are by interpolation, mostly graphical. 
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TABLE 10.7 — 5% ( Roman Type ) and 1% ( Bold 


ni 


ni degrees of freedom for numerator 



1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

23 

4.28 

7.88 

3.42 

5.66 

3.03 

4.76 

2.80 

4.26 

2.64 

3.94 

2.53 

3.71 

2.45 

3.54 

2.38 

3.41 

2.32 

3.30 

2.28 

3.21 

2.24 

3.14 

2.20 

3.07 

24 

4.26 

7.82 

3.40 

5.61 

3.01 

4.72 

2.78 

4.22 

2.62 

3.90 

2.51 

3.67 

2.43 

3.50 

2.36 

3.36 

2.30 

3.25 

2.26 

3.17 

2.22 

3.09 

2.18 

3.03 

25 

4.24 

7.77 

3.38 

5.57 

2.99 

4.68 

2.76 

4.18 

2.60 

3.86 

2.49 

3.63 

2.41 

3.46 

2.34 

3.32 

2.28 

3.21 

2.24 

3.13 

2.20 

3.05 

2.16 

2.99 

26 

4.22 

7.72 

3.37 

5.53 

2.98 

4.64 

2.74 

4.14 

2.59 

3.82 

2.47 

3.59 

2.39 

3.42 

2.32 

3.29 

2.27 

3.17 

2.22 

3.09 

2.18 

3.02 

2.15 

2.96 

27 

4.21 

7.68 

3.35 

5*49 

2.96 

4.60 

2.73 

4.11 

2.57 

3.79 

2.46 

3.56 

2.37 

3.39 

2.30 

3.26 

2.25 

3.14 

2.20 

3.06 

2.16 

2.98 

2.13 

2.93 

28 

4.20 

7.64 

3.34 

5.45 

2.95 

4.57 

2.71 

4.07 

2.56 

3.76 

2.44 

3.53 

2.36 

3.36 

2.29 

3.23 

2.24 

3.11 

2.19 

3.03 

2.15 

2.95 

2.12 

2.90 

29 

4.18 

7.60 

3.33 

5.42 

2.93 

4.54 

2.70 

4.04 

2.54 

3.73 

2.43 

3.50 

2.35 

3.33 

2.28 

3.20 

2.22 

3.08 

2.18 

3.00 

2.14 

2.92 

2.10 

2.87 

30 

4.17 

7.56 

3.32 

5.39 

2.92 

4.51 

2.69 

4.02 

2.53 

3.70 

2.42 

3.47 

2.34 

3.30 

2.27 

3.17 

2.21 

3.06 

2.16 

2.98 

2.12 

2.90 

2.09 

2.84 

32 

4.15 

7.50 

3.30 

5.34 

2.90 

4.46 

2.67 

3.97 

2.51 

3.66 

2.40 

3.42 

2.32 

3.25 

2.25 

3.12 

2.19 

3.01 

2.14 

2.94 

2.10 

2.86 

2.07 

2.80 

34 

4.13 

7.44 

3.28 

5.29 

2.88 

4.42 

2.65 

3.93 

2.49 

3.61 

2.38 

3.38 

2.30 

3.21 

2.23 

3.08 

2.17 

2.97 

2.12 

2.89 

2.08 

2.82 

2.05 

2.76 

36 

4.11 

7.39 

3.26 

5.25 

2.86 

4.38 

2.63 

3.89 

2.48 

3.58 

2.36 

3.35 

2.28 

3.18 

2.21 

3.04 

2.15 

2.94 

2.10 

2.86 

2.06 

2.78 

2.03 

2.72 

38 

4.10 

7.35 

3.25 

5.21 

2.85 

4.34 

2.62 

3.86 

2.46 

3.54 

2.35 

3.32 

2.26 

3.15 

2.19 

3.02 

2.14 

2.91 

2.09 

2.82 

2.05 

2.75 

2.02 

2.69 

40 

4.08 

7.31 

3.23 

5.18 

2.84 

4.31 

2.61 

3.83 

2.45 

3.51 

2.34 

3.29 

2.25 

3.12 

2.18 

2.99 

2.12 

2.88 

2.07 

2.80 

2.04 

2.73 

2.00 

2.66 

42 

4.07 

7.27 

3.22 

5.15 

2.83 

4.29 

2.59 

3.80 

2.44 

3.49 

2.32 

3.26 

2.24 

3.10 

2.17 

2.96 

2.11 

2.86 

2.06 

2.77 

2.02 

2.70 

1.99 

2.64 

44 

4.06 

7.24 

3.21 

5.12 

2.82 

4.26 

2.58 

3.78 

2.43 

3.46 

2.31 

3.24 

2.23 

3.07 

2.16 

2.94 

2.10 

2.84 

2.05 

2.75 

2.01 

2.68 

1.98 

2.62 

46 

4.05 

7.21 

3.20 

5.10 

2.81 

4.24 

2.57 

3.76 

2.42 

3.44 

2.30 

3.22 

2.22 

3.05 

2.14 

2.92 

2.09 

2.82 

2.04 

2.73 

2.00 

2.66 

1.97 

2.60 

48 

4.04 

7.19 

3.19 

5.08 

2.80 

4.22 

2.56 

3.74 

2.41 

3.42 

•2.30 

3.20 

2.21 

3.04 

2.14 

2.90 

2.08 

2.80 

2.03 

2.71 

1.99 

2.64 

1.96 

2.58 

50 

4.03 

7.17 

3.18 

5.06 

2.79 

4.20 

2.56 

3.72 

2.40 

3.41 

2.29 

3.18 

2.20 

3.02 

2.13 

2.88 

2.07 

2.78 

2.02 

2.70 

1.98 

2.62 

1.95 

2.56 

55 

4.02 

7.12 

3.17 

5.01 

2.78 

4.16 

2.54 

3.68 

2.38 

3.37 

2.27 

3.15 

2.18 

2.98 

2.11 

2.85 

2.05 

2.75 

2.00 

2.66 

1.97 

2.59 

1.93 

2.53 

60 

4.00 

7.08 

3.15 

4.98 

2.76 

4.13 

2.52 

3.65 

2.37 

3.34 

2.25 

3.12 

2.17 

2.95 

2.10 

2.82 

2.04 

2.72 

1.99 

2.63 

1.95 

2.56 

1.92 

2.50 

65 

3.99 

7.04 

3.14 

4.95 

2.75 

4.10 

2.51 

3.62 

2.36 

3.31 

2.24 

3.09 

2.15 

2.93 

2.08 

2.79 

2.02 

2.70 

1.98 

2.61 

1.94 

2.54 

1.90 

2.47 

70 

3.98 

7.01 

3.13 

4.92 

2.74 

4.08 

2.50 

3.60 

2.35 

3.29 

2.23 

3.07 

2.14 

2.91 

2.07 

2.77 

2.01 

2.67 

1.97 

2.59 

1.93 

2.51 

1.89 

2.45 


The function, F = e with exponent 2z, is 'computed in part from Fisher’s Table 
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14 16 20 24 30 40 50 75 100 200 500 °° 


2.14 

2.97 

2.10 

2.89 

2.04 

2.78 

2.00 

2.70 

1.96 

2.62 

1.91 

2.53 

1.88 

2.48 

1.84 

2.41 

1.82 

2.37 

1.79 

2.32 

1.77 

2.28 

1.76 

2.26 

23 

2.13 

2.93 

2.09 

2.85 

2.02 

2.74 

1.98 

2.66 

1.94 

2.58 

1.89 

2.49 

1.86 

2.44 

1.82 

2.36 

1.80 

2.33 

1.76 

2.27 

1.74 

2.23 

1.73 

2.21 

24 

2.11 

2.89 

2.06 

2.81 

2.00 

2.70 

1.96 

2.62 

1.92 

2.54 

1.87 

2.45 

1.84 

2.40 

1.80 

2.32 

1.77 

2.29 

1.74 

2.23 

1.72 

2.19 

1.71 

2.17 

25 

2.10 

2.86 

2.05 

2.77 

1.99 

2.66 

1.95 

2.58 

1.90 

2.50 

1.85 

2.41 

1.82 

2.36 

1.78 

2.28 

1.76 

2.25 

1.72 

2.19 

1.70 

2.15 

1.69 

2.13 

26 

2.08 

2.83 

2.03 

2.74 

1.97 

2.63 

1.93 

2.55 

1.88 

2.47 

1.84 

2.38 

1.80 

2.33 

1.76 

2.25 

1.74 

2.21 

1.71 

2.16 

1.68 

2.12 

1.67 

2.10 

27 

2.06 

2.80 

2.02 

2.71 

1.96 

2.60 

1.91 

2.52 

1.87 

2.44 

1.81 

2.35 

1.78 

2.30 

1.75 

2.22 

1.72 

2.18 

1.69 

2.13 

1.67 

2.09 

1.65 

2.06 

28 

2.05 

2.77 

2.00 

2.68 

1.94 

2.57 

1.90 

2.49 

1.85 

2.41 

1.80 

2.32 

1.77 

2.27 

1.73 

2.19 

1.71 

2.15 

1.68 

2.10 

1.65 

2.06 

1.64 

2.03 

29 

2.04 

2.74 

1.99 

2.66 

1.93 

2.55 

1.89 

2.47 

1.84 

2.38 

1.79 

2.29 

1.76 

2.24 

1.72 

2.16 

1.69 

2.13 

1.66 

2.07 

1.64 

2.03 

1.62 

2.01 

30 

2.02 

2.70 

1.97 

2.62 

1.91 

2.51 

1.86 

2.42 

1.82 

2.34 

1.76 

2.25 

1.74 

2.20 

1.69 

2.12 

1.67 

2.08 

1.64 

2.02 

1.61 

1.98 

1.59 

1.96 

32 

2.00 

2.66 

1.95 

2.58 

1.89 

2.47 

1.84 

2.38 

1.80 

2.30 

1.74 

2.21 

1.71 

2.15 

1.67 

2.08 

1.64 

2.04 

1.61 

1.98 

1.59 

1.94 

1.57 

1.91 

34 

1.98 

2.62 

1.93 

2.54 

1.87 

2.43 

1.82 

2.35 

1.78 

2.26 

1.72 

2.17 

1.69 

2.12 

1.65 

2.04 

1.62 

2.00 

1.59 

1.94 

1.56 

1.90 

1.55 

1.87 

36 

1.96 

2.59 

1.92 

2.51 

1.85 

2.40 

1.80 

2.32 

1.76 

2.22 

1.71 

2.14 

1.67 

2.08 

1.63 

2.00 

1.60 

1.97 

1.57 

1.90 

1.54 

1.86 

1.53 

1.84 

38 

1.95 

2.56 

1.90 

2.49 

1.84 

2.37 

1.79 

2.29 

1.74 

2.20 

1.69 

2.11 

1.66 

2.05 

1.61 

1.97 

1.59 

1.94 

1.55 

1.88 

1.53 

1.84 

1.51 

1.81 

40 

1.94 

2.54 

1.89 

2.46 

1.82 

2.35 

1.78 

2.26 

1.73 

2.17 

1.68 

2.08 

1.64 

2.02 

1.60 

1.94 

1.57 

1.91 

1.54 

1.85 

1.51 

1.80 

1.49 

1.78 

42 

1.92 

2.52 

1.88 

2.44 

1.81 

2.32 

1.76 

2.24 

1.72 

2.15 

1.66 

2.06 

1.63 

2.00 

1.58 

1.92 

1.56 

1.88 

1.52 

1.82 

1.50 

1.78 

1.48 

1.75 

44 

1.91 

2.50 

1.87 

2.42 

1.80 

2.30 

1.75 

2.22 

1.71 

2.13 

1.65 

2.04 

1.62 

1.98 

1.57 

1.90 

1.54 

1.86 

1.51 

1.80 

1.48 

1.76 

1.46 

1.72 

46 

1.90 

2.48 

1.86 

2.40 

1.79 

2.28 

1.74 

2.20 

1.70 

2.11 

1.64 

2.02 

1.61 

1.96 

1.56 

1.88 

1.53 

1.84 

1.50 

1.78 

1.47 

1.73 

1.45 

1.70 

48 

1.90 

2.46 

1.85 

2.39 

1.78 

2.26 

1.74 

2.18 

1.69 

2.10 

1.63 

2.00 

1.60 

1.94 

1.55 

1.86 

1.52 

1.82 

1.48 

1.76 

1.46 

1.71 

1.44 

1.68 

50 

1.88 

2.43 

1.83 

2.35 

1.76 

2.23 

1.72 

2.15 

1.67 

2.06 

1.61 

1.96 

1.58 

1.90 

1.52 

1.82 

1.50 

1.78 

1.46 

1.71 

1.43 

1.66 

1.41 

1.64 

55 

1.86 

2.40 

1.81 

2.32 

1.75 

2.20 

1.70 

2.12 

1.65 

2.03 

1.59 

1.93 

1.56 

1.87 

1.50 

1.79 

1.48 

1.74 

1.44 

1.68 

1.41 

1.63 

1.39 

1.60 

60 

1.85 

2.37 

1.80 

2.30 

1.73 

2.18 

1.68 

2.09 

1.63 

2.00 

1.57 

1.90 

1.54 

1.84 

1.49 

1.76 

1.46 

1.71 

1.42 

1.64 

1 39 
1.60 

1.37 

1.56 

65 

1.84 

2.35 

1.79 

2.28 

1.72 

2.15 

1.67 

2.07 

1.62 

1.98 

1.56 

1.88 

1.53 

1.82 

1.47 

1.74 

1.45 

1.69 

1.40 

1.62 

1.37 

1.56 

1.35 

1.53 

70 


VI (7). Additional entries are by interpolation , mostly graphical . 
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TABLE 10.7 — 5% ( Roman Type ) and 1% ( Bold 


m degrees of freedom for numerator 


nj 



1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

80 

3.96 

6.96 

3.11 

4.88 

2.72 

4.04 

2.48 

3.56 

2.33 

3.25 

2.21 

3.04 

2.12 

2.87 

2.05 

2.74 

1.99 

2.64 

1.95 

2.55 

1.91 

2.48 

1.88 

2.41 

100 

3.94 

6.90 

3.09 

4.82 

2.70 

3.98 

2.46 

3.51 

2.30 

3.20 

2.19 

2.99 

2.10 

2.82 

2.03 

2.69 

1.97 

2.59 

1.92 

2.51 

1.88 

2.43 

1.85 

2.36 

125 

3.92 

6.84 

3.07 

4.78 

2.68 

3.94 

2.44 

3.47 

2.29 

3.17 

2.17 

2.95 

2.08 

2.79 

2.01 

2.65 

1.95 

2.56 

1.90 

2.47 

1.86 

2.40 

1.83 

2.33 

150 

3.91 

6.81 

3.06 

4.75 

2.67 

3.91 

2.43 

3.44 

2.27 

3.14 

2.16 

2.92 

2.07 

2.76 

2.00 

2.62 

1.94 

2.53 

1.89 

2.44 

1.85 

2.37 

1.82 

2.30 

200 

3.89 

6.76 

3.04 

4.71 

2.65 

3.88 

2.41 

3.41 

2.26 

3.11 

2.14 

2.90 

2.05 

2.73 

1.98 

2.60 

1.92 

2.50 

1.87 

2.41 

1.83 

2.34 

1.80 

2.28 

400 

3.86 

6.70 

3.02 

4.66 

2.62 

3.83 

2.39 

3.36 

2.23 

3.06 

2.12 

2.85 

2.03 

2.69 

1.96 

2.55 

1.90 

2.46 

1.85 

2.37 

1.81 

2.29 

1.78 

2.23 

1000 

3.85 

6.66 

3.00 

4.62 

2.61 

3.80 

2.38 

3.34 

2.22 

3.04 

2.10 

2.82 

2.02 

2.66 

1.95 

2.53 

1.89 

2.43 

1.84 

2.34 

1.80 

2.26 

1.76 

2.20 

CO 

3.84 

6.64 

2.99 

4.60 

2.60 

3.78 

2.37 

3.32 

2.21 

3.02 

2.09 

2.80 

2.01 

2.64 

1.94 

2.51 

1.88 

2.41 

1.83 

2.32 

1.79 

2.24 

1.75 

2.18 


The function, F = e with exponent 2 z, is computed in part from Fisher’s Table 
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Face Type) Points for the Distribution of F 


m degrees of freedom for numerator 


14 

16 

20 

24 

30 

40 

50 

75 

100 

200 

500 

GO 

nj 

1.82 

2.32 

1.77 

2.24 

1.70 

2.11 

1.65 

2.03 

1.60 

1.94 

1.54 

1.84 

1.51 

1.78 

1.45 

1.70 

1.42 

1.65 

1.38 

1.57 

1.35 

1.52 

1.32 

1.49 

80 

1.79 

2.26 

1.75 

2.19 

1.68 

2.06 

1.63 

1.98 

1.57 

1.89 

1.51 

1.79 

1.48 

1.73 

1.42 

1.64 

1.39 

1.59 

1.34 

1.51 

1.30 

1.46 

1.28 

1.43 

100 

1.77 

2.23 

1.72 

2.15 

1.65 

2.03 

1.60 

1.94 

1.55 

1.85 

1.49 

1.75 

1.45 

1.68 

1.39 

1.59 

1.36 

1.54 

1.31 

1.46 

1.27 

1.40 

1.25 

1.37 

125 

1.76 

2.20 

1.71 

2.12 

1.64 

2.00 

1.59 

1.91 

1.54 

1.83 

1.47 

1.72 

1.44 

1.66 

1.37 

1.56 

1.34 

1.51 

1.29 

1.43 

1.25 

1.37 

1.22 

1.33 

150 

1.74 

2.17 

1.69 

2.09 

1.62 

1.97 

1.57 

1.88 

1.52 

1.79 

1.45 

1.69 

1.42 

1.62 

1.35 

1.53 

1.32 

1.48 

1.26 

1.39 

1.22 

1.33 

1.19 

1.28 

200 

1.72 

2.12 

1.67 

2.04 

1.60 

1.92 

1.54 

1.84 

1.49 

1.74 

1.42 

1.64 

1.38 

1.57 

1.32 

1.47 

1.28 

1.42 

1.22 

1.32 

1.16 

1.24 

1.13 

1.19 

400 

1.70 

2.09 

1.65 

2.01 

1.58 

1.89 

1.53 

1.81 

1.47 

1.71 

1.41 

1.61 

1.36 

1.54 

1.30 

1.44 

1.26 

1.38 

1.19 

1.28 

1.13 

1.19 

1.08 

1.11 

1000 

1.69 

2.07 

1.64 

1.99 

1.57 

1.87 

1.52 

1.79 

1.46 

1.69 

1.40 

1.59 

1.35 

1.52 

1.28 

1.41 

1.24 

1.36 

1.17 

1.25 

1.11 

1.15 

1.00 

1.00 

CO 


VI (7). Additional entries are by interpolation, mostly graphical. 
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TABLE X . Table of Eh-n and the corresponding values of Pj j 

/. - 1 


/. 

E*qm 

< t > 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.980 

.970 

947 

.914 

.874 

.828 

.720 

.602 

.484 

.373 

.277 

4 

.841 

.949 

.885 

.784 

.651 

.501 

.233 

.077 

.018 

.003 


6 

.696 

.934 

.839 

.687 

.498 

.312 

.076 

.010 

.001 



7 

.636 

.928 

.822 

.652 

.447 

.258 

.049 

.006 




8 

.585 

.924 

.808 

.624 

.409 

.221 

.034 

.002 




9 

.540 

.920 

.796 

.601 

.379 

.193 

.025 

.001 




10 

.501 

.916 

.786 

.582 

.355 

.172 

.019 

.001 




11 

.467 

.913 

.777 

.567 

.336 

.156 

.015 





12 

.437 

.911 

.770 

.553 

.320 

.144 

.012 





13 

.411 

.909 

.763 

.542 

.307 

.133 

.010 





14 

.388 

907 

.758 

.532 

.296 

.125 

.009 





15 

.367 

.905 

.753 

.523 

.286 

.118 

.008 





16 

.348 

.904 

.749 

.516 

.278 

.112 

.007 





17 

.331 

.902 

.745 

.509 

.271 

.107 

.006 





18 

.315 

.901 

.741 

.503 

.264 

.103 

.006 





19 

.301 

.900 

.738 

.498 

.259 

.099 

.005 





20 

.288 

.899 

.735 

.493 

.254 

.096 

.005 





22 

.265 

.897 

.730 

.484 

.245 

.090 

.004 





24 

.246 

.896 

.726 

.477 

.238 

.086 

.004 





26 

.229 

.894 

.722 

.471 

.232 

.082 

.003 





28 

.214 

.893 

.718 

.466 

.227 

.079 

.003 





30 

.201 

.892 

.716 

.462 

.223 

.077 

.003 





60 

.106 

.885 

.696 

.430 

.194 

.061 

.002 





00 


.877 

.675 

.400 

.169 

.048 

.001 






/i = 2 


h 

3 1 

J 

* 1 


1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.990 

.975 

.957 

.932 

.901 

.865 

.779 

.680 

.577 

.475 

.379 

4 

.900 

.957 

.901 

.810 

.685 

.540 

.266 

.095 

.024 

.004 

.001 

6 

.785 

.941 

.850 

.695 

.498 

.305 

.068 

.007 




7 

.732 

.934 

.828 

.649 

.431 

.235 

.035 

.004 




8 

.684 

.929 

.809 

.611 

.379 

.187 

.021 

.001 




9 

.641 

.924 

.793 

.579 

.338 

.152 

.013 





10 

.602 

.920 

.779 

.552 

.306 

.127 

.008 





11 

.567 

.916 

.767 

.528 

.278 

.108 

.006 





12 

.536 

.912 

.756 

.508 

.255 

.093 

.005 





13 

.508 

.909 

.746 

.491 

.237 

.082 

.003 





14 

.482 

.907 

.738 

.476 

.223 

.074 

.002 





15 

.459 

.904 

.730 

.463 

.211 

.066 

.002 





16 

.438 

.902 

.723 

.452 

.201 

.060 

.001 





17 

.418 

.900 

.717 

.442 

.193 

.055 

.001 





18 

.401 

.898 

.711 

.433 

.185 

.051 

.001 





19 

.384 

.896 

.706 

.424 

.177 

.048 

.001 





20 

.369 

.895 

.701 

.417 

.170 

.045 

.001 





22 

.342 

.893 

.693 

.404 

.160 

.040 

.001 





24 

.319 

.890 

.686 

.394 

.151 

.036 






26 

.298 

.888 

.680 

.385 

.144 

.034 






28 

.280 

.886 

.675 

.377 

.138 

.031 






30 

.264 

.885 

.670 

.370 

.134 

.029 






60 

.142 

.873 

.637 

.324 

.102 

.019 






CO 


.860 

.601 

.279 

.076 

.011 





■ 


189 


TABLE I. Table EVoi and the corresponding values or En ( continued ) 


ft = 3 


/. 

£*0.01 

<*> 


1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.993 

.977 

.961 

.939 

.911 

.878 

.800 

.709 

.612 

.515 

.421 

4 

.926 

.959 

.907 

.818 

.695 

.552 

.276 

.100 

.026 

.005 

.001 

6 

.830 

.943 

.850 

.691 

.486 

.290 

.059 

.006 




7 

.784 

.936 

.825 

.636 

.408 

.210 

.025 

.002 




8 

.740 

.929 

.803 

.590 

.347 

.158 

.014 





9 

.700 

.923 

.783 

.550 

.299 

.120 

.008 





10 

.663 

.918 

.765 

.517 

.261 

.094 

.004 





11 

.629 

.913 

.749 

.487 

.231 

.075 

.002 





12 

.598 

.909 

.735 

.463 

.206 

.062 

.001 





13 

.570 

.906 

.723 

.441 

.186 

.051 

.001 





14 

.544 

.902 

.711 

.422 

.170 

.044 

.001 





15 

.520 

.899 

.701 

.406 

.156 

.038 

.001 





16 

.498 

.896 

.692 

.391 

.145 

.033 






17 

.478 

.893 

.683 

.378 

.135 

.029 






18 

.459 

.891 

.676 

.367 

.126 

.026 






19 

.442 

.889 

.669 

.356 

.119 

.023 






20 

.426 

.887 

.662 

.347 

.112 

.021 






22 

.396 

.883 

.651 

.331 

.102 

.017 






24 

.371 

.880 

.641 

.318 

.094 

.015 






26 

.349 

.877 

.633 

.307 

.087 

.013 






28 

.329 

.875 

.625 

.297 

.081 

.012 






30 

.311 

.872 

.619 

.289 

.077 

.011 






60 

.171 

.856 

.571 

.233 

.050 

.005 






CO 


.836 

.519 

.182 

.030 

.002 







/. = 4 


/> 

£*0.01 

< t > 



1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.995 

.978 

.962 

.942 

.915 

.884 

.810 

.724 

.631 

.536 

.444 

4 

.941 

.960 

.909 

.822 

.700 

.557 

.280 

.102 

.027 

.005 

.001 

6 

.859 

.943 

.849 

.685 

.475 

.277 

.053 

.005 




7 

.818 

.936 

.821 

.624 

.389 

.191 

.018 





8 

.778 

.928 

.796 

.571 

.322 

.136 

.010 





9 

.741 

.922 

.773 

.526 

.269 

.098 

.003 





10 

.706 

.916 

.752 

.487 

.227 

.073 

.002 





11 

.673 

.911 

.733 

.453 

.195 

.055 

.001 





12 

.643 

.906 

.716 

.424 

.169 

.042 

.001 





13 

.616 

.901 

.700 

.398 

.148 

.034 






14 

.590 

.897 

.687 

.376 

.131 

.028 






15 

.566 

.893 

.674 

.357 

.117 

.022 






16 

.544 

.890 

.662 

.340 

.106 

.018 






17 

.523 

.886 

.652 

.325 

.096 

.015 






18 

.504 

.883 

.642 

.312 

.088 

.013 






19 

.486 

.880 

.633 

.301 

.081 

.011 






20 

.470 

.878 

.625 

.290 

.075 

.010 






22 

.440 

.873 

.611 

.272 

.066 

.008 






24 

.413 

.869 

.598 

.257 

.059 

.006 






26 

.389 

.865 

.588 

.244 

.053 

.005 






28 

.368 

.862 

.578 

.234 

.048 

.005 






30 

.349 

.860 

.570 

.225 

.044 

.004 






60 

.196 

.837 

.509 

.165 

.024 

.001 






00 


.810 

.443 

.115 

.011 

1 
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TABLE I . Table of Eh . 01 and the corresponding values of P n { continued ) 

/i = 5 


/. 

#*0.01 




< t > 

1 

1.5 

2 

2.5 

3 

4 

5' 

6 

7 

8 

2 

.996 

.978 

.964 

.944 

.918 

.888 

.817 

.733 

.642 

.549 

458 

4 

.951 

.961 

.910 

.824 

.702 

.559 

.282 

.103 

.027 

.005 

001 

8 

.879 

.943 

.848 

.079 

.466 

.266 

.048 

.004 




7 

.842 

.935 

.818 

.614 

.394 

.177 

014 





8 

.806 

.928 

.790 

.556 

.301 

.121 

.007 





9 

.771 

.920 

764 

.505 

.245 

.083 

.003 





10 

.738 

.914 

.740 

.461 

.201 

.058 

.001 





11 

.707 

.908 

.718 

.424 

.168 

.042 






12 

. .679 

.902 

.699 

.391 

.141 

.031 






13 

.652 

.897 

.681 

.363 

.120 

.023 






14 

.626 

.892 

.664 

.339 

.104 

.018 






15 

.603 

.888 

.649 

.318 

.090 

.014 




1 

16 

.581 

.883 

.636 

.299 

.079 

.011 






17 

.561 

.880 

.624 

.283 

.071 

.009 






18 

.541 

.876 

.612 

.269 

.063 

.007 






19 

.523 

.873 

.602 

.256 

.057 

.006 






20 

.506 

.870 

.592 

.245 

.052 

.005 






22 

.475 

.864 

.575 

.225 

.044 

.004 






24 

.448 

.859 

.560 

.210 

.037 

.003 






26 

.423 

.855 

.547 

.196 

033 

.002 






28 

.401 

.851 

.536 

.185 

.029 

.002 






30 

.381 

.847 

.526 

.176 

.026 

.002 






60 

.218 

.819 

.452 

.116 

.011 







00 


.784 

.373 

.070 

.004 








/i - 6 


h 

#*0.01 



1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.997 

.978 

.964 

.945 

.920 

.891 

.821 

.739 

.650 

.558 

.468 

4 

.958 

.962 

.911 

.825 

.704 

.560 

.283 

.104 

.027 

.005 

001 

6 

.894 

.944 

.847 

.675 

.459 

.258 

.044 

.003 




7 

.860 

.935 

.815 

.605 

.362 

.166 

Oil 





8 

.827 

.927 

.784 

.543 

.285 

.109 

.006 





9 

.795 

.919 

.756 

.488 

.226 

.071 

.003 





10 

.764 

.912 

.730 

.441 

.181 

.048 

.001 





11 

.734 

.905 

.706 

.400 

.147 

.033 






12 

.707 

.899 

.683 

.365 

.120 

.023 






13 

.681 

.893 

.663 

.334 

.100 

.017 






14 

.656 

.888 

.645 

.308 

.084 

.013 






15 

.633 

.882 

.628 

.286 

.071 

009 






16 

.612 

.878 

.612 

.266 

.061 

.007 






17 

.591 

.873 

.598 

.249 

.053 

.005 






18 

.572 

.869 

.585 

.233 

.046 

.004 






19 

.554 

.865 

.573 

.220 

.041 

.003 






20 

.537 

.862 

.562 

.208 

.036 

003 






22 

506 

.855 

.542 

.188 

.029 

.002 






24 

.478 

.849 

.524 

.172 

.024 

.001 






26 

.453 

.844 

.510 

.159 

.020 

.001 






28 

.430 

.839 

.497 

.147 

.017 

.001 






30 

.410 

.835 

.486 

.138 

.015 

.001 






60 

.238 

.801 

.401 

.081 

.006 







00 


.765 

.311 

.042 

.001 
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TABLE I . Table of jEVoi and the corbespondinq taloeb of -Pjj ( continued ) 

A = 7 


A 

E 1 o.oi 


1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.997 

.979 

.965 

.946 

.922 

.893 

.824 

.743 

.655 

.564 

.475 

4 

.963 

.962 

912 

.826 

.705 

.561 

.283 

.104 

.027 

.005 

.001 

6 

.906 

.944 

.845 

.671 

.452 

.251 

.041 

.003 




7 

.875 

.935 

.812 

.598 

.351 

.158 

.009 





8 

.844 

.926 

.779 

.532 

.272 

.100 

.005 





9 

.814 

.918 

.749 

.474 

.211 

.063 - 

.002 





10 

.785 

.910 

.720 

.423 

.166 

.041 

.001 





11 

.757 

.903 

.694 

.379 

.131 

.027 






12 

.730 

.896 

.670 

.342 

.105 

.018 






13 

.705 

.889 

.648 

.310 

.085 

.013 






14 

.681 

.883 

.627 

.283 

.069 

.009 






15 

.659 

.878 

.608 

.259 

.057 

.007 






16 

.638 

.872 

.591 

.238 

.048 

.004 






17 

.618 

.868 

.575 

.220 

.041 

.003 






18 

.599 

.863 

.561 

.205 

.035 

.002 






19 

.581 

.859 

.548 

.191 

.030 

.002 






20 

.564 

.854 

.535 

.179 

.026 

.002 






22 

.533 

.847 

.513 

.159 

.020 

.001 






24 

.505 

.840 

.494 

.143 

.016 

.001 






26 

.479 

.834 

.477 

.130 

.013 







28 

.456 

.829 

.463 

.119 

.011 







30 

.435 

.824 

.450 

.110 

.009 







60 

.256 

.783 

.355 

.056 

.003 







00 


.729 

.256 

.024 









A = 8 


h 

£* 0.01 


1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.997 

.979 

.965 

.946 

.923 

.894 

.826 

.746 

.659 

.569 

.481 

4 

.967 

.962 

.912 

.826 

.705 

.562 

.284 

.104 

.027 

.005 

.001 

6 

.915 

.944 

.844 

.668 

.447 

.246 

.039 

.003 




7 

.887 

.934 

.809 

.592 

.343 

.151 

.007 





8 

.858 

.925 

.775 

.522 

.261 

.093 

.004 





9 

.829 

.917 

.743 

.461 

.199 

.056 






10 

.802 

.908 

.712 

.408 

.153 

.035 






11 

.775 

.901 

.684 

.363 

.118 

.022 






12 

.750 

.893 

.658 

.324 

.092 

.014 






13 

.726 

.886 

.634 

.290 

.073 

.009 






14 

.703 

.880 

.612 

.261 

.058 

.006 






15 

.681 

.874 

.591 

.237 

.047 

.004 






16 

.660 

.868 

.573 

.216 

.039 

.003 






17 

.641 

.862 

.555 

.197 

.032 

.002 






18 

.622 

.857 

.539 

.181 

.027 

.002 






19 

.605 

.852 

.525 

.168 

.023 

.001 






20 

.588 

.848 

.511 

.156 

.019 

.001 






22 

.557 

.839 

.487 

.135 

.014 







24 

.529 

.832 

.466 

.119 

.011 







26 

.503 

.825 

.447 

.107 

.009 







28 

.480 

.819 

.432 

.096 

.007 







30 

.458 

.813 

.418 

.088 

.006 







60 

.274 

.766 

.315 

.039 

.001 







OO 


.702 

.211 

.014 
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TABLE II. Table of Eh . 05 and the coresponding values of Pjj 

/. = 1 


h 

E * 0.06 

< t > 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.903 

.862 

.763 

.643 

.517 

.395 

.200 

.083 

.028 

.008 

.002 

4 

.858 

.805 

.631 

.428 

.247 

.120 

.016 

.001 




6 

.500 

.777 

.570 

.343 

.164 

.061 

.004 





7 

.444 

.768 

.552 

.319 

.144 

.050 

.003 





8 

.399 

.761 

.537 

.302 

.129 

.041 

.002 





9 

.362 

.756 

.526 

.288 

.119 

.036 

001 





10 

.332 

.751 

.517 

.278 

111 

.032 

.001 





11 

.306 

.747 

.510 

.269 

. 105 

.029 

.001 





12 

.284 

.744 

.504 

.262 

.100 

.027 

.001 





13 

.264 

.741 

.499 

.256 

.096 

.025 

.001 





14 

.247 

.739 

.494 

.251 

.093 

.024 

.001 





15 

.232 

.737 

.490 

.247 

.090 

.023 






16 

.219 

.735 

.487 

.243 

.087 

.022 






17 

.207 

.734 

.484 

.240 

.085 

.021 






18 

.197 

.732 

.481 

.237 

.084 

.020 






19 

.187 

.731 

.479 

.235 

.082 

.020 






20 

.179 

.730 

.477 

.233 

.081 

.019 






22 

.164 

.728 

.473 

.229 

.078 

.018 






24 

.151 

.726 

.470 

.226 

.076 

.018 






26 

.140 

.725 

.467 

.223 

.075 

.017 






28 

.130 

.723 

.465 

.221 

.073 

.017 






30 

.122 

.722 

.463 

.219 

072 

.016 






60 

.063 

.715 

.450 

.205 

.065 

.014 






CO 


.707 

.437 

.193 

.058 

.011 







/1 = 2 


ii 

E * o . 05 

< t > 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.950 

.881 

.803 

.704 

.595 

.484 

.286 

.146 

.064 

.024 

.008 

4 

.776 

.824 

.661 

.460 

.272 

.135 

.020 

.001 




6 

.632 

.789 

.579 

.340 

.153 

.052 

.002 





7 

.575 

.777 

.551 

.304 

.124 

.037 

.001 





8 

.527 

.767 

.530 

.277 

.104 

.027 

.001 





9 

.486 

.759 

.513 

.257 

.090 

.022 






10 

.451 

.752 

.498 

.241 

.080 

.017 






11 

.420 

.747 

.486 

.228 

.072 

.015 






12 

.393 

.742 

.476 

.217 

.066 

.013 






13 

.369 

.737 

.468 

.208 

.061 

.011 






14 

.348 

.734 

.461 

.201 

.057 

.010 






15 

.329 

.730 

.454 

.195 

.054 

.009 






16 

.312 

.727 

.448 

.189 

.051 

.008 






17 

.297 

.725 

.443 

.184 

.048 

.008 






18 

.283 

.722 

.439 

.180 

.046 

.007 






19 

.270 

.720 

.435 

.177 

.044 

.007 






20 

.259 

.718 

.431 

.173 

.043 

.006 






22 

.238 

.715 

.425 

.168 

.040 

.006 






24 

.221 

.712 

.420 

.163 

.038 

.005 






26 

.206 

.710 

.415 

.159 

.037 

.005 






28 

.193 

.708 

.411 

.155 

.035 

.005 






30 

.181 

.706 

.408 

.153 

.034 

.004 






60 

.095 

.692 

.384 

.134 

.027 

.003 






CO 


.678 

.362 

.117 

.021 

.002 
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TABLE II. Table of jBVo # and the corresponding valuer of Pjj ( continued ) 


/. - 3 


/• 

E i 0 06 

< t > 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.966 

.888 

.817 

.726 

.624 

.519 

.324 

.177 

.084 

.035 

.013 

4 

.832 

.830 

.670 

.468 

.278 

.139 

.020 

.001 




6 

.704 

.791 

.574 

.326 

.139 

.044 

.002 





7 

.651 

.776 

.540 

.283 

.106 

.028 






8 

.604 

.764 

.513 

.251 

.084 

.018 






9 

.563 

.754 

.491 

.226 

.068 

.013 






10 

.527 

.745 

.472 

206 

.057 

.010 






11 

.495 

.738 

.457 

.190 

.049 

.008 






12 

.466 

.731 

.444 

.178 

.043 

.006 






13 

.440 

.726 

.433 

.167 

.038 

.005 






14 

.418 

.721 

.422 

.158 

.035 

.004 






15 

.397 

.716 

.414 

.151 

.032 

.004 






16 

.378 

.712 

.406 

.144 

.029 

.003 






17 

.361 

.709 

.399 

.139 

.027 

.003 






18 

.345 

.705 

.393 

.134 

.025 

002 






19 

.331 

.702 

.388 

.130 

.024 

.002 






20 

.317 

.700 

.383 

.126 

.022 

.002 






22 

.294 

.695 

.375 

.119 

.020 

.002 






24 

.273 

.691 

.367 

.114 

.019 

.001 






26 

.255 

.687 

.361 

.110 

.017 

.001 






28 

.240 

.084 

.356 

.106 

.016 

.001 






30 

.226 

.682 

.352 

.103 

.015 

.001 






60 

.121 

.662 

.320 

.083 

.010 

.001 






00 


.642 

.289 

.067 

.007 








/i = 4 


/> 

■£*0.06 

<*> 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.975 

.892 

.824 

.738 

.640 

.537 

.345 

.195 

.097 

.043 

.017 

4 

.865 

.833 

.673 

.471 

.279 

.139 

.020 

.001 




6 

.751 

.791 

.567 

.314 

.128 

.038 

.001 





7 

.702 

.774 

.529 

.265 

.092 

.022 






8 

.657 

.760 

.497 

.229 

.069 

.013 






9 

.618 

.748 

.471 

.201 

.054 

.008 






10 

.582 

.738 

.449 

.179 

.043 

.006 






11 

.550 

.729 

.430 

.161 

.035 

.004 






12 

.521 

.721 

.414 

.148 

.030 

.003 






13 

.494 

.714 

.401 

.136 

j 025 

.002 






14 

.471 

.708 

.389 

.127 

.022 

.002 






15 

.449 

.702 

.378 

.119 

.019 

.002 






16 

.429 

.697 

.369 

.112 

.017 

.001 






17 

.411 

.693 

.361 

.106 

.016 

.001 






18 

.394 

.689 

.354 

.101 

.014 

.001 






19 

.379 

.685 

.347 

.097 

.013 

.001 






20 

.364 

.681 

.341 

.093 

.012 

.001 






22 

.339 

.675 

.331 

.086 

.010 

.001 






24 

.316 

.670 

.322 

.080 

.009 







26 

.297 

.665 

.315 

.076 

.008 







28 

.279 

.661 

.309 

.072 

.008 







30 

.264 

.658 

.303 

.069 

.007 







60 

144 

.632 

.265 

.049 

.004 







00 


.604 

.227 

.036 

.002 




1 
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TABLE II . Table of E * o.o* and the correspondinq values of P n ( continued ) 
h - 5 


/> 

E*v. 05 

< t > 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.980 

.894 

.828 

.745 

.649 

.549 

.359 

.207 

.106 

.048 

.019 

4 

.887 

.835 

.675 

.473 

.280 

.138 

.020 

.001 




6 

.785 

.790 

.561 

.304 

.119 

.033 

.001 





7 

.739 

.772 

.519 

.251 

.082 

.018 






8 

.697 

.756 

.483 

.211 

.059 

.010 






9 

.659 

.743 

.454 

.181 

.044 

.006 






10 

.625 

.731 

.429 

.158 

.033 

.004 






11 

.593 

.720 

.408 

.140 

.026 

.002 






12 

.564 

.711 

.390 

.125 

.021 

.002 






13 

.538 

.703 

.374 

.113 

.017 

.001 






14 

.514 

.695 

.360 

.103 

.015 

.001 






15 

.492 

.689 

.348 

.095 

.012 

.001 






16 

.471 

.683 

.338 

.088 

Oil 

.001 






17 

.452 

.678 

.328 

.083 

.009 







18 

.435 

.673 

.320 

.078 

.008 







19 

.419 

.668 

.312 

.073 

.007 







20 

.404 

.664 

.305 

.069 

.007 







22 

.377 

.656 

.294 

.063 

.006 







24 

.353 

.650 

.284 

.058 

.005 







26 

.332 

.644 

.275 

.054 

.004 







28 

.314 

.640 

.268 

.050 

.004 







30 

.297 

.635 

.262 

.048 

.003 







60 

.165 

.604 

.219 

.031 

.001 







00 


.567 

.177 

.019 

.001 








1 = 6 


A 

E 2 0.06 


1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.983 

.895 

.831 

.749 

.656 

.557 

.368 

.216 

.112 

.052 

.022 

4 

.902 

.836 

.677 

.473 

.280 

.138 

.019 

.001 




6 

.811 

.789 

.556 

.296 

.113 

.030 

.001 





7 

.768 

.769 

.510 

.239 

.074 

.015 






8 

.729 

.753 

.472 

.198 

.051 

.008 






9 

.692 

.738 

.440 

.166 

.037 

.005 






10 

.659 

.725 

.412 

.142 

.027 

.003 






11 

.628 

.713 

.389 

.123 

.020 

.002 






12 

.600 

.702 

.369 

• 108 

.016 

.001 






13 

.574 

.693 

.351 

.096 

.012 

.001 






14 

.550 

.685 

.336 

.086 

.010 

.001 






15 

.527 

.677 

.323 

.078 

.008 







16 

.507 

.669 

.311 

.071 

.007 







17 

.488 

.663 

.301 

.065 

.006 







18 

.470 

.657 

.291 

.061 

.005 







19 

.454 

.652 

.283 

.056 

.004 







20 

.438 

.648 

.276 

.053 

.004 







22 

.410 

.639 

.262 

.047 

.003 







24 

.385 

.632 

.252 

.043 

.003 







26 

.363 

.625 

.242 

.039 

.002 







28 

.344 

.620 

.234 

.036 

.002 







30 

.326 

.615 

.228 

.033 

.002 







60 

.184 

.676 

.181 

.019 

.001 







CO 


.532 

.138 

.010 
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TABLE II . Table of E*om and the cobbesfondino values of Pj j ( continued ) 
A = 7 


/• 

E * 0 . 0 l 

4 > 

1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.986 

.896 

.833 

.753 

.660 

.563 

.374 

.222 

.117 

.055 

.023 

4 

.914 

.837 

.678 

.474 

.280 

.138 

.019 

.001 




6 

.831 

.788 

.552 

.289 

.108 

.028 

.001 





7 

.791 

.767 

.503 

.230 

.068 

.013 






8 

.754 

.749 

.462 

.187 

.046 

.007 






9 

.719 

.733 

.427 

.154 

.031 

.004 






10 

.687 

.719 

.398 

.129 

.022 

.002 






11 

.657 

.706 

.373 

.110 

.016 

.001 






12 

.630 

.695 

.351 

.094 

.012 

.001 






13 

.604 

.684 

.332 

.082 

.009 







14 

.580 

.675 

.316 

.073 

.007 







15 

.558 

.667 

.301 

.065 

.006 







16 

.538 

.659 

.289 

.058 

.005 







17 

.518 

.652 

.277 

.053 

.004 







18 

.501 

.645 

.267 

.048 

.003 







19 

.484 

.639 

.258 

.044 

.003 







20 

.468 

.634 

.250 

.041 

.002 







22 

.439 

.624 

.236 

.036 

.002 







24 

.414 

.615 

.224 

.032 

.001 







26 

.391 

.607 

.215 

.028 

.001 







28 

.371 

.601 

.206 

.026 

.001 







30 

.353 

.595 

.199 

.023 

.001 







60 

.202 

.550 

.150 

.012 








00 


.498 

.105 

.005 









A = 8 


A 

E * 0.06 


1 

1.5 

2 

2.5 

3 

4 

5 

6 

7 

8 

2 

.987 

.897 

.835 

.755 

.664 

.567 

.380 

.227 

.121 

.057 

.024 

4 

.924 

.838 

.678 

.474 

.279 

.137 

.019 

.001 




6 

.847 

.787 

.548 

.284 

.103 

.026 

.001 





7 

.810 

.765 

.497 

.222 

.064 

.012 






8 

.775 

.746 

.454 

.178 

.041 

.006 






9 

.742 

.729 

.417 

.144 

.028 

.003 






10 

.711 

.714 

.386 

.119 

.019 

.001 






11 

.682 

.700 

.359 

.099 

.013 

.001 






12 

.655 

.688 

.336 

.084 

.009 







13 

.630 

.677 

.316 

.072 

.007 







14 

.607 

.666 

.298 

.062 

.005 







15 

.585 

.657 

.283 

.055 

.004 







16 

.564 

.648 

.269 

.048 

.003 







17 

.545 

.641 

.257 

.043 

.003 







18 

.527 

.634 

.247 

.039 

.002 







19 

.510 

.627 

.237 

.035 

.002 







20 

.495 

.620 

.228 

.032 

.001 







22 

.466 

.609 

.213 

.027 

.001 







24 

.440 

.600 

.201 

.024 

.001 







26 

.417 

.591 

.191 

.021 

.001 







28 

.396 

.584 

.182 

.019 








30 

.377 

.578 

.175 

.017 








60 

.219 

.527 

.125 

.008 








00 


.466 

.081 

.003 
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